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(54) ENVIRONMENTAL COMPLEXITY ARITHMETIC SYSTEM. ENVIRONMENTAL RECOGNITION LEVEL 
ESTIMATION SYSTEM AND OBSTRUCTION WARNING SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To support obstruction recognition 
efficiently and accurately without presenting a driver with excessive 
information. 

SOLUTION: A microcomputer 70 divides a pickup image produced by an 
obstruction imaging CCD camera 21 into regions A to D, and computes 
complexity C of traffic environment in each of the regions B to D 
according to the following expression: C=a.C1+6.C2+y.C1 .C2, where the 
index C1 represents a total number of brightness-divided blocks, the 
index C2 represents a total number of red-system-divided blocks, and a, 
6 and y are weight coefficients of respective given values. 



□ I 

^ II 




LEGAL STATUS 

[Date of request for examination] 

[Date of sending the examiners decision of rejection] 

[Kind of final disposal of application other than the 

examiner's decision of rejection or application 

converted registration] 

[Date of final disposal for application] 

[Patent number] 

[Date of registration] 

[Number of appeal against examiner's decision of 
rejection] 

[Date of requesting appeal against examiner's decision 
of rejection] 

[Date of extinction of right] 



Copyright (C); 1998,2003 Japan Patent Office 



, * NOTICES * 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LTHis document has been translated by computer. So the translation may not reflect the original precisely. 
2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The environmental complexity arithmetic unit equipped with a complexity operation means to calculate 
environmental complexity, at least based on one side of distribution of change of the brightness contained in the 
image pick-up image generated with an image pick-up means to generate an image pick-up image based on the 
image pick-up light from an environment, and said image pick-up means, and distribution of the red system pixel 
contained in said image pick-up image. 

[Claim 2] Until said complexity operation means sets a brightness division block as the image pick-up image 
generated with said image pick-up means and is judged that the brightness value of each pixel is homogeneous 
in the set-up brightness division block The environmental complexity arithmetic unit according to claim 1 
characterized by calculating environmental complexity based on the number of the brightness division blocks 
with which it repeated dividing said brightness division block and setting up a new brightness division block, and 
the brightness value of each pixel became homogeneity to said image pick-up image. 

[Claim 3] Said complexity operation means until it sets a red system division block as the image pick-up image 
generated with said image pick-up means and the set-up red system division block consists of only 
predetermined red system pixels Repeat dividing said red system division block and setting up a new red system 
division block, and said image pick-up image is received. The environmental complexity arithmetic unit according 
to claim 1 characterized by calculating environmental complexity based on the number of the red system division 
blocks which consist of only said predetermined red system pixels. 

[Claim 4] Until said complexity operation means sets a brightness division block as the image pick-up image 
generated with said image pick-up means and is judged that the brightness value of each pixel is homogeneous 
in the set-up brightness division block Repeat dividing said brightness division block and setting up a new 
brightness division block, and said image pick-up image is received. Until it calculates the number of the 
brightness division blocks with which the brightness value of each pixel became homogeneity, it sets a red 
system division block as the image pick-up image generated with said image pick-up means and the set-up red 
system division block consists of only predetermined red system pixels Repeat dividing said red system division 
block and setting up a new red system division block, and said image pick-up image is received. The 
environmental complexity arithmetic unit according to claim 1 characterized by calculating the number of the red 
system division blocks which consist of only said predetermined red system pixels, and calculating environmental 
complexity based on the number of said brightness division blocks, and the number of red system division blocks. 

[Claim 5] Environmental recognition degree presumption equipment equipped with an environmental recognition 
degree presumption means to presume an environmental recognition degree based on the complexity calculated 
with the complexity arithmetic unit and said complexity arithmetic unit of four given in any 1 term from claim 1. 
[Claim 6] It is environmental recognition degree presumption equipment according to claim 5 characterized by 
1 presuming that the environmental recognition degree of said environmental recognition degree presumption 
means is low when the complexity calculated with said complexity arithmetic unit is beyond a threshold, and 
presuming that an environmental recognition degree is high when the complexity calculated with said complexity 
arithmetic unit is smaller than a threshold. 

[Claim 7] It is environmental recognition degree presumption equipment according to claim 5 or 6 which is 
further equipped with an illuminance detection means to detect an environmental illuminance, and said 
environmental recognition degree presumption means sets up said threshold corresponding to the illuminance 
detected by said illuminance detection means, and is characterized by presuming an environmental recognition 
degree using the set-up threshold. 

[Claim 8] It has further a posture change detection means to detect posture change of an observer. Said 
environmental recognition degree presumption means A threshold is greatly set up as posture change of an 
observer detected with said posture change detection means becomes large. Environmental recognition degree 
presumption equipment of seven given in any 1 term from claim 5 which sets up a threshold small and is 
characterized by presuming an environmental recognition degree using the set-up threshold as posture change 



, of an observer detected with said posture change detection means becomes small. 
[Claim 9] The obstruction alarm equipped with an alarm means perform the alarm about said obstruction when a 
predetermined field including the location of the obstruction detected with an obstruction location detection 
means detect the environmental recognition degree presumption equipment of eight given in any 1 term and the 
location of an obstruction from claim 5 which presumes an environmental recognition degree for every 
predetermined field, and said obstruction detection means is presumed that an environmental recognition degree 
is low by said environmental recognition degree presumption means. 

[Claim 10] Said environmental recognition degree presumption equipment divides the field except the lower part 
of an image pick-up image into two or more presumed fields, and an environmental recognition degree is 
presumed for every divided presumption field. Said alarm means When the location of the obstruction detected 
by said obstruction location detection means is in any of said presumed field and the recognition degree of the 
environment of the presumed field concerned is presumed to be low by said environmental recognition degree 
presumption means The obstruction alarm according to claim 9 characterized by performing the alarm about the 
obstruction which exists in the high presumed field of a priority. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to an environmental complexity arithmetic unit, environmental 
recognition degree presumption equipment, and an obstruction alarm, and relates to the environmental 
complexity arithmetic unit, the environmental recognition degree presumption equipment, and the obstruction 
alarm which offer obstruction recognition exchange of a driver especially according to the traffic environment of 
the perimeter of a car. 
[0002] 

[Description of the Prior Art] In operation of a car, it is important to check elutriation from right and left in the 
time of rectilinear propagation of a car or to check a crossing object on either side to a travelling direction in the 
time of the right and left chip box of a car, when preventing accident. The mobile which jumps out of right and 
left, or is crossed can consider various things, such as a pedestrian, a two-flower vehicle, and a four-flower 
vehicle. 

[0003] In JP,3-260813,A, the environmental recognition equipment which detects such a mobile is proposed. 
Environmental recognition equipment acquired profile information by extracting the difference and the closed 
interval field of lightness information, and recognizes the migration body from profile information. However, since 
the lighting conditions which surround a car change every moment and have the influence of disturbance light 
etc., it is rare to be able to extract a profile completely vividly. Therefore, since the above-mentioned 
environmental recognition equipment performs image recognition only using profile information, its 
correspondence to an environmental variation from the little of amount of information is weak. In the case where 
it is carried in a car and an obstruction etc. is detected especially, since it is influenced [ which was mentioned 
above ] greatly, it is hard to say that a mobile is detectable the optimal. Moreover, since the lightness which w,as 
easy to be influenced of a shadow, disturbance light, etc., and changed with disturbance light affects change of a 
center of gravity or area directly, the processing which extracts a direct closed interval from lightness 
information is difficult. 

[0004] In addition, the detection technique which added internal information to profile information, such as 
template matching and texture matching, is also proposed. However, the processing time starts or there is a 
problem of taking the time and effort which prepares the huge information about a template beforehand. 
[0005] Under such a background, it is derived from the technique which compresses image information, and the 
technique of catching the image pick-up information on a camera with distribution of lightness data is proposed 
in recent years. 

[0006] In JP,1 1-142168,A, principal component analysis which is one of the multivariate analyses is performed, 
image pick-up information is mapped in the information space stretched with normalization principal component 
characteristic quantity, and the technique which improved the technique of carrying out image recognition is 
proposed by analyzing the behavior of the data in information space. This technique performs more robust 
environmental recognition for normalization principal component characteristic quantity using car movement 
information and actuation information. Moreover, in JP,2000-19259,A, the technique of recognizing a body using 
visible-ray image information and infrared image information other than the light is proposed. 

[0007] However, these techniques are difficult to recognize a mobile, when many factors which bar recognition of 
bodies, such as a guard rail and a halt vehicle, exist. For example, there is a problem which cannot recognize the 
pedestrian in the foot walks or crossings other than on [ through which a car passes ] a road surface, and the 
pedestrian who has run out of between the standby location of a bicycle or a halt vehicle. 

[0008] On the other hand, for example by JP,1 1-301 343 A the lighting system for cars which used not only the 
obstruction itself but the camera (light, infrared rays) and which predicts the appearance rate of a migration 
obstruction according to environmental (road configuration) recognition is proposed. Moreover, in JP,11- 
232569A the pedestrian alarm system with the equipment which sends to a vehicle side whether the pedestrian 
approached the crossing etc. is proposed. Furthermore, in JP,6-144129,A, the nudge assistant equipment which 
aims at a nudge by choosing at random one cautions item by which two or more preparation was carried out to 



•the same condition of being careful, and reporting to a driver is proposed, without recognizing a migration 
obstruction positively. 

[0009] Thus, the migration obstruction recognition exchange which offers obstruction recognition exchange to a 
driver is proposed by performing approach warning of the thing in consideration of the automatic recognition of a 
migration obstruction, and the appearance probability of a migration body, or a pedestrian etc. 
[0010] However, finally the driver itself recognizes a migration obstruction. If the vision cognition of the driver 
and a cognitive property were not taken into consideration, since a lot of information was shown to the driver 
too much, a driver may be confused on the contrary. Moreover, although there are few amounts of information 
presentation, they are inefficient. [ of the approach of uniting a cautions item with a location and showing it at 
random ] 

[0011] This invention is proposed in order to solve the technical problem mentioned above, and it aims at 
offering the environmental complexity arithmetic unit, the environmental recognition degree presumption 
equipment, and the obstruction alarm which can offer obstruction recognition exchange efficiently and exactly, 
without showing a driver superfluous information. 
[0012] 

[Means for Solving the Problem] Invention according to claim 1 is equipped with a complexity operation means to 
calculate environmental Complexity, at least based on one side of distribution of change of the brightness 
contained in the image pick-up image generated with an image pick-up means to generate an image pick-up 
image based on the image pick-up light from an environment, and said image pick-up means, and distribution of 
the red system pixel contained in said image pick-up image. 

[0013] As for an image pick-up means, in invention according to claim 1, it is desirable to be installed so that a 
front traffic environment may be picturized for example, from a car front seat. A complexity operation means can 
ask for the spatial frequency which shows the complexity of an image from distribution of brightness change 
included in an image pick-up image. Moreover, a complexity operation means can ask for the complexity of an 
image from distribution of the red system pixel contained in an image pick-up image. 

[0014] Invention according to claim 2 is set to invention according to claim 1. Said complexity operation means 
Until it sets a brightness division block as the image pick-up image generated with said image pick-up means and 
it is judged in the set-up brightness division block that the brightness value of each pixel is homogeneous It 
repeats dividing said brightness division block and setting up a new brightness division block, and is 
characterized by calculating environmental complexity to said image pick-up image based on the number of the 
brightness division blocks with which the brightness value of each pixel became homogeneity. 
[0015] In invention according to claim 2, a complexity operation means sets up a brightness division block to an 
image pick-up image. The brightness division block set up first shows the field which calculates complexity. And 
said brightness division block is divided, the divided brightness division block is set up as a new brightness 
division block, and this processing is repeated until it is judged in a brightness division block that the brightness 
value of each pixel is homogeneous. Here, the difference of the maximum of not only when the brightness value 
of each pixel is in agreement in the brightness value of each pixel being homogeneous, but a brightness value 
and the minimum value of a brightness value should just be below a predetermined value. Namely, dispersion in 
the brightness value of each pixel has just become below a predetermined value. 

[0016] And if it is judged that the brightness value of each pixel in all brightness division fields is homogeneous, 
it will ask for the number of these the brightness division blocks of all as environmental complexity. The number 
of such brightness division blocks supports spatial frequency. That is, if there are many totals, there are many 
high frequency components and an image pick-up image is complicated. Moreover, if there are few totals, there 
are few high frequency components and the image pick-up image is simple. Thus, it can ask for environmental 
complexity by asking for the number of brightness division blocks. 

[0017] Invention according to claim 3 is set to invention according to claim 1. Said complexity operation means 
Until it sets a red system division block as the image pick-up image generated with said image pick-up means 
and the set-up red system division block consists of only predetermined red system -pixels It repeats dividing 
said red system division block and setting up a new red system division block, and is characterized by calculating 
environmental complexity to said image pick-up image based on the number of the red system division blocks 
which consist of only said predetermined red system pixels. 

[0018] In invention according to claim 3, a complexity operation means sets up a red system division block to an 
image pick-up image. The red system division block set up first shows the field which calculates complexity. The 
red system division block concerned is divided until a red system division block consists of only predetermined 
red system pixels. And the divided red system division block is set up as a new red system division block, and 
this processing is repeated. If all red system division blocks consist of only predetermined red system pixels, it 
will ask for the number of these the red system division blocks of all as environmental complexity. Red is 
compared green, and has the property that eye attractiveness is high, and, as for the number of red system 
division blocks, the complexity of an image is shown. Therefore, it can ask for environmental complexity by 



• calculating the number of the above-mentioned red system division blocks. 

[0019] Invention according to claim 4 is set to invention according to claim 1. Said complexity operation means 
Untif it sets a brightness division block as the image pick-up image generated with said image pick-up means and 
it is judged in the set-up brightness division block that the brightness value of each pixel is homogeneous 
Repeat dividing said brightness division block and setting up a new brightness division block, and said image 
pick-up image is received. Until it calculates the number of the brightness division blocks with which the 
brightness value of each pixel became homogeneity, it sets a red system division block as the image pick-up 
image generated with said image pick-up means and the set-up red system division block consists of only 
predetermined red system pixels Repeat dividing said red system division block and setting up a new red system 
division block, and said image pick-up image is received. It is characterized by calculating the number of the red 
system division blocks which consist of only said predetermined red system pixels, and calculating environmental 
complexity based on the number of said brightness division blocks, and the number of red system division blocks. 

[0020] In invention according to claim 4, a complexity operation means asks for the number of brightness division 
blocks like invention according to claim 2 t asks for the number of red system division blocks like invention 
according to claim 3 further, and asks for environmental complexity based on these totals. It is desirable to 
square a respectively predetermined weighting multiplier to the product of the number of brightness division 
blocks, the number of red system division blocks, the number of brightness division blocks, and the number of 
red system division blocks, and to ask for these total as environmental complexity, at it. 

[0021] Invention according to claim 5 is equipped with an environmental recognition degree presumption means 
to presume an environmental recognition degree based on the complexity calculated with the complexity 
arithmetic unit and said complexity arithmetic unit of four given in any 1 term from claim 1. 

[0022] In invention according to claim 5, since the complexity of an environmental image pick-up image is shown, 
the complexity calculated with the complexity arithmetic unit is used as a parameter for presuming the 
recognition degree of an observers environment. That is, an environmental recognition degree presumption 
means can presume an environmental recognition degree based on the above-mentioned complexity. 
[0023] It is characterized by presuming that the environmental recognition degree of invention according to claim 
6 is low in invention according to claim 5 when the complexity which calculated said environmental recognition 
degree presumption means with said complexity arithmetic unit is beyond a threshold, and presuming that an 
environmental recognition degree is high when the complexity calculated with said complexity arithmetic unit is 
smaller than a threshold. 

[0024] In invention according to claim 6, the threshold used as the reference value of an environmental 
recognition degree is set up. That is, a threshold is a value of the complexity which shows simple middle that an 
environment is complicated. Then, it presumes that the environmental recognition degree of an environmental 
recognition degree presumption means is low when complexity is beyond a threshold in using this threshold, and 
when complexity is smaller than a threshold, it can be presumed that an environmental recognition degree is 
high. 

[0025] It is characterized by equipping invention according to claim 7 with an illuminance detection means to 
detect an environmental illuminance, further in invention according to claim 5 or 6, and for said environmental 
recognition degree presumption means setting up said threshold corresponding to the illuminance detected by 
said illuminance detection means, and presuming an environmental recognition degree using the set-up 
threshold. 

[0026] In invention according to claim 7, even if complexity is fixed, when it is bright in the car exterior or it 
becomes dark, an observer may sense that an environment is complicated or may sense that it is simple. Then, 
in order to amend change of the recognition degree of the environment by change of such an illuminance, it is 
desirable to use the threshold table on which the threshold corresponding to an illuminance was described 
beforehand. Thereby, if an illuminance is detected by the illuminance detection means, the threshold 
corresponding to the detected illuminance can be set up. And an environmental recognition degree can be 
presumed using the set-up threshold. Consequently, no matter an illuminance may be what value, an 
environmental recognition degree can be presumed correctly. 

[0027] Invention according to claim 8 is further equipped with a posture change detection means to detect 
posture change of an observer in invention of seven given in any 1 term from claim 5. Said environmental 
recognition degree presumption means It is characterized by presuming an environmental recognition degree 
using the threshold which set up the threshold greatly as posture change of an observer detected with said 
posture change detection means became large, set up the threshold small and was set up as posture change of 
an observer detected with said posture change detection means became small. 

[0028] In invention according to claim 8, an observer has the degree which recognizes an environment in a high 
inclination, when posture change is large. By setting up a threshold greatly as posture change of an observer 
becomes large, and setting up a threshold small as posture change of an observer becomes small, an 



■ environmental recognition degree presumption means can presume an environmental recognition degree 
correctly so that it may agree in an observer's actual vision property. 

[0029] The environmental recognition degree presumption equipment of eight given in any 1 term from claim 5 
invention according to claim 9 presumes an environmental recognition degree to be for every predetermined 
field; When a predetermined field including the location of the obstruction detected with an obstruction location 
detection means to detect the location of an obstruction, and said obstruction detection means is presumed 
that an environmental recognition degree is low by said environmental recognition degree presumption means, it 
has an alarm means to perform the alarm about said obstruction. 

[0030] In invention according to claim 9, an obstruction location detection means detects the location of an 
obstruction. At this time, environmental recognition degree presumption equipment presumes the recognition 
degree of the environment of a predetermined field including the location where the obstruction was detected. 
Here, when an environmental recognition degree is high, an observer can recognize enough the obstruction 
detected by the obstruction location detection means. On the other hand, when an environmental recognition 
degree is low, an observer may be unable to recognize the obstruction detected by the obstruction location 
detection means. Then, an alarm means performs the alarm about an obstruction, when it is presumed that the 
environmental recognition degree of a predetermined field including the location of an obstruction is low. 
Thereby, even when an obstruction is in the field where an environmental recognition degree is low, an observer 
can recognize in advance that there is an obstruction and can avoid accident. In addition, when it is presumed 
that the environmental recognition degree of the predetermined [ an observer can be made to call attention 
when an alarm means outputs an image or voice ] field in which an alarm means includes the location of an 
obstruction again is high, the alarm about an obstruction is not performed. Thereby, in the case where an 
obstruction is in the field where an environmental recognition degree is high, since an observer can recognize 
the obstruction, he does not receive troublesomeness with an excessive alarm. 

[0031] Invention according to claim 10 is set to invention according to claim 9. Said environmental recognition 
degree presumption equipment The field except the lower part of an image pick-up image is divided into two or 
more presumed fields, and an environmental recognition degree is presumed for every divided presumption field. 
Said alarm means When the location of the obstruction detected by said obstruction location detection means is 
in any of said presumed field and the recognition degree of the environment of the presumed field concerned is 
presumed to be low by said environmental recognition degree presumption means It is characterized by 
performing the alarm about the obstruction which exists in the high presumed field of a priority. 
[0032] In invention according to claim 10, environmental recognition degree presumption equipment divides the 
field except the lower part of an image pick-up image into two or more presumed fields, and presumes an 
environmental recognition degree for every divided presumption field. That is, an environmental recognition 
degree is not presumed about the lower part of an image pick-up image. The lower part of an image pick-up - 
screen shows the image of the environment in front of an observer, and the reason is that there is no semantics 
which presumes the degree of recognition of the environment. 

[0033] It judges whether an alarm means has the location of the obstruction detected by said obstruction 
location detection means in any of said presumed field, and the recognition degree of the environment of the 
presumed field concerned was presumed to be low by said environmental recognition degree presumption means. 
Here, an obstruction is detected and an environmental recognition degree chooses all low presumption fields. 
And the alarm of a purport with which an obstruction exists is performed about the high presumed field of a 
priority among the selected appointed fields. While big accident is avoidable by making an observer careful of the 
thereby most dangerous field, about the field which is not not much dangerous, it can prevent an observer 
becoming a surfeit of information and getting confused by not reporting to an observer. 
[0034] 

[Embodiment of the Invention] It explains to a detail, referring to a drawing about the gestalt of desirable 
operation of this invention hereafter. 

[0035] The gestalt of operation of the 1st of [gestalt of the 1st operation] this invention is applicable to the 
obstruction alarm 1 of a configuration of being shown in drawing 1 . The obstruction alarm 1 the infrastructure 
information which detects infrastructure information from the infrastructure of the car exterior The 
infrastructure information detecting element 1 0, The obstruction information detecting element 20 which detects 
a road and the information about the obstruction of the circumference of it, The self-vehicle condition detecting 
element 30 which detects the operating state of a self-car, and the environmental-information detecting 
element 40 which detects the environment of a driver or the car exterior, It has the slider panel 50 for inputting 
the vision property which shows the degree of environmental recognition of a driver, the obstruction information 
output section 60 which outputs obstruction information, and the microcomputer 70 which controls the whole 
based on the information detected in each part. 

[0036] The infrastructure information detecting element 10 is equipped with the GPS receiving circuit 1 1 which 
receives a GPS (Global PositioningSystem) signal, the DVD drive 12 which reads the map information currently 



* recorded on the DVD disk, and the approach information receiving circuit 13 which receives approach 
information. 

[0037] The GPS receiving circuit 11 receives the GPS signal which has the positional information of time of day 
and a GPS Satellite through GPS antenna 11a, and supplies it to a microcomputer 70 through a data bus 5. 
Based on the positional information which is carrying out current transit, a car reads map information from a 
DVD disk, and supplies the DVD drive 12 to a microcomputer 70 through a data bus 5. The approach information 
receiving circuit 13 receives the approach information transmitted from the data carrier reader mentioned later, 
and supplies it to a microcomputer 70 through a data bus 5. 

[0038] The obstruction information detecting element 20 is equipped with CCD camera 21 for obstruction 
photography for photoing the obstruction of a path on the street or the perimeter of a road, the infrared camera 
22 for photoing the obstruction of a path on the street or the perimeter of a road with infrared radiation, and the 
radar transceiver 23 for recognizing a forward cardiac failure theory object. 

[0039] CCD camera 21 for obstruction photography and the infrared camera 22 are installed so that the body of 
the direction of the car front can be picturized. And CCD camera 21 for obstruction photography and the 
infrared camera 22 supply the photoed photography image to a microcomputer 70 through a data bus 5. A radar 
transceiver 23 receives the optical radar reflected by the obstruction while extracting a pulse-like optical radar 
keenly to the obstruction concerned and transmitting in the two-dimensional direction, in order to recognize a 
forward cardiac failure theory object, in addition, a radar transceiver 23 may be a thing which does not restrict, 
but transmits and receives an electric-wave radar and which transmits and receives an optical radar. 
[0040] The self-vehicle condition detecting element 30 is equipped with for example, a wheel speed sensor, a 
steering angle sensor, a throttle-valve sensor, the master cylinder oil pressure sensor, the yaw rate sensor, the 
order acceleration sensor, the lateral acceleration sensor, etc. And the self-vehicle condition detecting element 
30 detects the vehicle speed, a handle steering include angle, an accelerator control input, the amount of brakes 
operation, a yaw rate, a roll rate, a pitch rate, order acceleration, lateral acceleration, and a winker control input, 
and supplies them to a microcomputer 70. 

[0041] The environmental-information detecting element 40 is equipped with the illuminance sensor 41 which 
detects the illuminance of the car exterior, and CCD camera 42 for driver photography which photos a driver. 
Here, although only one CCD camera 42 for driver photography is formed, three CCD cameras which picturize 
the method of forward presence of a driver, the method of the forward right, and the method of the forward left, 
respectively may be formed so that posture change of a driver can be detected easily. 
[0042] The slider panel 50 is for carrying out the actuation input of the vision property which shows the 
complexity of an external environment according to the subjectivity of a driver. As shown in the slider panel 50 
and drawing 2 , it has the movable slider 51 right and left. A driver operates a slider 51 in the direction of 
"weakness", when he tends to overlook the traffic environment (i.e., when judging that it is hard to recognize the 
traffic environment of the car exterior). Moreover, a driver operates a slider 51 in the direction of "a little more 
than", when a traffic environment can be seen well (i.e., when it is easy to recognize the traffic environment of 
the car exterior). Although this mentions later in detail, a microcomputer 70 can presume an environmental 
recognition degree in consideration of the present vision property of a driver. 

[0043] The obstruction information output section 60 is equipped with LCD (Liquid Crystal Display)61 which 
outputs obstruction information with an image, and the loudspeaker 62 which outputs obstruction information 
with voice. 

[0044] The microcomputer 70 is constituted by CPU (Central Processing Unit) which is not illustrated, RAM 
(Random Access Memory) which is the work area of data, and ROM (Read Only Memory) the program and 
appearance range presumption table which perform various kinds of routine processings mentioned later, and the 
threshold table are remembered to be. A microcomputer 70 presumes an obstruction with appearance possibility 
based on the information from each part, presumes the environmental recognition degree of a driver, or performs 
the alarm of obstruction information. 

[0045] (Main routine) In the obstruction alarm 1 constituted as mentioned above, a rrticrocomputer 70 performs 
processing from the step ST 1 shown in drawing 3 to a step ST 3. "Here, processing from a step ST 1 to a step 
ST 3 is explained briefly first, and the concrete subroutine of each processing is explained after that. 
[0046] A microcomputer 70 presumes the obstruction which may appear in the travelling direction of a self- 
vehicle while detecting a self-vehicle location based on the information detected by the infrastructure 
information detecting element 10 (step ST 1). And the environmental recognition degree which shows whether 
the image pick-up image of the environment of the travelling direction of a self-vehicle is divided, and it is easy 
to recognize a driver for every divided field is presumed (step ST 2). Finally, a microcomputer 70 performs the 
alarm about an obstruction to a driver if needed based on obstruction information with appearance possibility, 
and the environmental recognition degree for every predetermined field with an image or voice (step ST 3). 
[0047] ((ST) Step 1) At a step ST 1, a microcomputer 70 performs processing from the step ST 1 1 specifically 
shown in drawing 4 to a step ST 14 that the obstruction which may appear in the travelling direction of a self- 



•vehicle should be presumed. 

[0048] At a step ST 1 1, a microcomputer 70 is the circumference of a self-vehicle location, and detects the 
migration obstruction outside the field-of-view range of a driver while it detects the location of a self-vehicle. In 
addition, an infrastructure which is explained below, for example is used here. 

[0049] For example, as shown in drayying 5 , the pedestrian is always carrying the goods (for example, cellular 
phone) with which the data carrier 16 was formed. Moreover, the data carrier 16 is formed in the two-flower 
vehicle or the four-flower vehicle. A data carrier 1 6 can output some kinds of approach information, and the data 
carrier 1 6 of a pedestrian, a two-flower vehicle, and a four-flower vehicle outputs approach information different, 
respectively. On the other hand, the data carrier reader 17 which receives approach information is installed in 
the bad crossing and bad zebra zone of a prospect. If a data carrier 1 6 approaches, the data carrier reader 1 7 
will receive approach information, and will transmit this approach information to the obstruction alarm 1. 
[0050] If the approach information transmitted from the data carrier reader 17 is received in the approach 
information receiving circuit 13, the microcomputer 70 of the obstruction alarm 1 can pinpoint the location of an 
obstruction, and can recognize any of a pedestrian, a two-flower vehicle, and a four-flower vehicle the 
obstruction is further. 

[0051] And a microcomputer 70 is the circumference of a self-vehicle location, detects the migration 
obstruction outside the field-of-view range of a driver, and recognizes the classification (a man, a two flower 
vehicle, or a four flower vehicle) of the migration obstruction concerned while it detects the location of a self- 
vehicle based on the GPS signal received by the GPS receiving circuit 11, the map information read from the 
DVD drive 12, and the approach information received by the approach information receiving circuit 13. 
[0052] Furthermore, a microcomputer 70 presumes the range where a migration obstruction on the street 
[ around a self-vehicle ] may appear based on the classification of a migration obstruction with reference to the 
appearance range presumption table shown in drawing 6 R> 6. For example, when the four-flower vehicle has 
been recognized as a migration obstruction, the four-flower vehicle concerned presumes that a microcomputer 
70 may appear in a travelling direction within the limits of 10m from a current location. Moreover, when the 
pedestrian has been recognized as a migration obstruction, the pedestrian concerned presumes that it may 
appear in within the limits with a radius of 1 m from the current position. 

[0053] A microcomputer 70 sets up the system of coordinates (henceforth "self-vehicle circumference system 
of coordinates") which consist of a shaft which intersects perpendicularly with the travelling direction shaft and 
travelling direction shaft of a self-vehicle, describes the appearance possibility range of a migration obstruction 
to self-vehicle circumference system of coordinates, and shifts to a step ST 12. 

[0054] At a step ST 12, a microcomputer 70 detects the obstruction in field-of-view within the limits of a driver. 
Here, a microcomputer 70 makes CCD camera 21 for obstruction photography, and the infrared camera 22 drive, 
and acquires the image pick-up image generated with CCD camera 21 for obstruction photography, and the 
infrared camera 22. And a migration obstruction is detected by obtaining the image which fully attached contrast 
for human being who poses a problem especially on insurance, or a vehicle with the other thing by asking for the 
difference of the image generated with each camera. 

[0055] Moreover, based on the both-way time amount of the optical radar from transmission by the radar 
transceiver 23 to reception, a microcomputer 70 obtains the depth map of the forward cardiac failure theory 
object of a self-vehicle, and recognizes a forward cardiac failure theory object. A microcomputer 70 describes 
the migration obstruction recognized by doing in this way to self-vehicle circumference system of coordinates, 
and shifts to a step ST 1 3. 

[0056] At a step ST 13, a microcomputer 70 detects a self-vehicle condition based on the information from the 
self-vehicle condition detecting element 30. Here, a microcomputer 70 detects the vehicle speed, a handle 
steering include angle, an accelerator control input, the amount of brakes operation, a yaw rate, a roll rate, a 
pitch rate, order acceleration, lateral acceleration, and a winker control input, presumes the travelling direction 
of a self-vehicle, describes the presumed result of the travelling direction of a self-vehicle to self-vehicle 
circumference system of coordinates, and shifts to a step ST 14 as indicated by JP,1 1-301343A for example. 
[0057] At a step ST 14, a microcomputer 70 leaves only the information on a migration obstruction that it may 
appear in advance prediction within the limits of a self-vehicle, to the self-vehicle circumference system of 
coordinates obtained by processing from a step ST 1 1 to a step ST 13, and removes the information on other. 
And if a microcomputer 70 is displayed on LCD61 by using as an obstruction display screen information about 
the migration obstruction described by self-vehicle circumference system of coordinates, it will shift to the step 
ST 2 which escaped from the subroutine and was shown in drawing 3 . 

[0058] Here, the obstruction display screen shows the map of the perimeter the self-vehicle is running, the 
current position of a self-vehicle, the advance prediction range of a self-vehicle, and migration obstructions 
(people, vehicle, etc.) and the range of those which can be appeared, as shown in d rawing 7 . The magnitude of 
the migration obstruction displayed on the obstruction display screen shows the range where the migration 
obstruction concerned may appear. 



'[0059} ((ST) Step 2) At a step ST 2, a microcomputer 70 performs processing from the step ST 21 specifically 
shown in drawing 8 to a step ST 24 that the degree a driver recognizes a perimeter [ car ] environment to be 
should be presumed. 

[0060] At a step ST 21, a microcomputer 70 detects change of the posture of a driver using the information 
from the environmental-information detecting element 40. namely, the microcomputer 70 — the image pick-up 
image from CCD camera 42 for driver photography — inter-frame [ every ] — difference — asking — the 
difference of an image pick-up image — a value is detected as migration space quantity of a driver. 
[0061] A microcomputer 70 counts "1", when migration space quantity is beyond a predetermined threshold, and 
when migration space quantity is smaller than a predetermined threshold, it does not count. And the counted 
value concerned is one or more thresholds TH, the counted value for the past 5 minutes is calculated, for 
example, when the counted value concerned is less than one threshold TH, it judges with posture change being 
"smallness", when it is under the threshold TH2 (> TH1), it judges with posture change being "inside", and when 
the counted value concerned is two or more thresholds TH, it judges with posture change being "size." 
Moreover, a microcomputer 70 acquires the illuminance of the car exterior detected by the illuminance sensor 
41, and shifts to a step ST 22. 

[0062] At a step ST 22, a microcomputer 70 calculates the environmental complexity C for every predetermined 
field of the obstruction display screen shown in drawing 7 . In addition, the complexity C said here means the 
parameter used in order to presume the recognition degree of the traffic environment of a driver. 
[0063] First, a microcomputer 70 quadrisects the field which has an obstruction and its range which can be 
appeared among the obstruction display screens obtained at a step ST 1 in distance and a direction. Here, as 
shown in drawing 9 , the obstruction display screen is divided into Field A, Field B, Field C, and Field D. Thereby, 
the above-mentioned obstruction display screen adjoins Field A and Field A which are a field of the front 
transverse-plane short distance of a self-vehicle, adjoins Field B and Fields A and B which are fields of a front 
transverse-plane long distance of a self-vehicle, adjoins Field C and Fields A and B which are fields of a front 
left long distance of a self-vehicle, and has the field D which is a field of a front right long distance of a self- 
vehicle. In addition, from the obstruction display screen field A, typically, Field D is divided, as shown in dr awin g 
10 . 

[0064] Next, a microcomputer 70 calculates the complexity C of a traffic environment about each of Field B, 
Field C, and Field D based on the following formula (1). 
[0065] 
[Equation 1] 

C - a- C1+ p* C2+ y* CIC2 (l) 

[0066] An index C1 shows the number of brightness division blocks, and the index C2 shows the number of red 
system division blocks. Moreover, alpha, beta, and gamma are weighting multipliers and take a predetermined 
value, respectively. 

[0067] Here, the operation of an index C1 is explained. In addition, although a microcomputer 70 calculates an 
index C1 about Field B, Field C, and Field D as mentioned above, it explains calculating an index C1 using the 
image pick-up image shown in drawing j| | about Field B here. 

[0068] A microcomputer 70 obtains an image pick-up image as made drive CCD camera 21 for obstruction 
photography, for example, shown in drawing 1 1 . And the whole image pick-up image concerned is set up as a 
brightness division block. 

[0069] A microcomputer 70 calculates the difference of the maximum of the brightness value of each pixel, and 
the minimum value in the set-up brightness division block. A microcomputer 70 judges whether they are the 
maximum of a brightness value, and beyond a threshold predetermined in the difference of the minimum value, 
and when the above-mentioned difference is over the predetermined threshold, it divides a brightness division 
block into four. At this time, as for a microcomputer 70, it is desirable to divide a brightness division block so 
that it may consist of almost same numbers of pixels in every direction, and so that it may enlarge as much as 
possible. 

[0070] When the brightness value of an image pick-up image shows drawin g 12 (A), a microcomputer 70 
calculates the difference of the maximum (180) of a brightness value, and the minimum value (000). And since it 
judged whether the difference (180) of the maximum of a brightness value and the minimum value was beyond a 
threshold (for example, 40) and the above-mentioned difference is over the threshold (40) here, as shown in 
drawing 12 (A), a brightness division block is divided into four. 

[0071] A microcomputer 70 divides said brightness division block into four, and repeats setting up a new 
brightness division block until the difference of the maximum of the brightness value of each pixel and the 
minimum value becomes below a predetermined threshold in each divided brightness division block. 
[0072] For example, the brightness division block BK1 shown in drawing 12 (A) consists of 4x4 pixels, and the 
minimum value of 180 and a brightness value of the maximum of a brightness value is 20. A microcomputer 70 



•searches for the difference (160) of the maximum of the brightness value of the brightness division block BK1, 
and the minimum value, and since the above-mentioned difference is beyond a threshold (40), as shown in 
drawin g 1 2 (B), it divides the brightness division block BK1 into four (BK2, BK3, BK4, BK5). 

[0073] And since the difference (39) of the maximum of the brightness value of the brightness division block BK2 
and the minimum value is not beyond a threshold (40), a microcomputer 70 does not divide to the brightness 
division block BK2. On the other hand, about the brightness division blocks BK3, BK4, and BK5, since the 
difference of the maximum of a brightness value and the minimum value is beyond a threshold (40), as shown in 
drawing 1212 (C), each brightness division block BK is divided. 

[0074] Passing through such processing, a microcomputer 70 asks for the index C1 which shows the number of 
the brightness division blocks with which the difference of the maximum of the brightness value of each pixel 
and the minimum value became below a predetermined threshold (40). Thereby, a microcomputer 70 makes 
homogeneity the brightness value of each pixel which constitutes a brightness division block. 
[0075] In addition, an index C1 is not limited to the number of brightness division blocks which became the 
maximum of the brightness value of each pixel, and below a threshold predetermined in the difference of the 
minimum value. For example, an index C1 may be the variance of the brightness value of an image pick-up image. 
Moreover, an index C1 may be total of the high frequency component of the two-dimensional fast Fourier 
transform (FFT:Fast Fourier Transform) of an image pick-up image. 

[0076] Moreover, as shown in drawing 12 R> 2 (C), it divided until the brightness division block BK became 1x1 
pixel, but a microcomputer 70 may end division, when it becomes the magnitude (for example, 4x4 pixels) which 
divided the brightness division block BK and was defined beforehand. 

[0077] Below, the operation of an index C2 is explained. In addition, although C2 which indicates that the number 
of red system division blocks mentioned the microcomputer 70 above for every predetermined field is calculated, 
it explains calculating an index C2 about Field B using the image pick-up image shown in drawing 13 (A) here. 
[0078] A microcomputer 70 obtains an image pick-up image as made drive CCD camera 21 for obstruction 
photography, for example, shown in drawing 13 (A). And an image pick-up image as extracted 0.3 or more 
lightness and 0.1 or more saturation from the image pick-up image concerned, for example, shown in drawing 
1313 (B) is obtained. Furthermore, a microcomputer 70 will obtain an image pick-up image as shown in drawing 
13 (C), if 0.1 or less and 0.75 or more hues are extracted. 

[0079] To an image pick-up image as shown in draw ing 13 (C), a microcomputer 70 repeats block division so that 
the inside of the same red system division block may occupy only by the red system pixel, and as shown in 
draw ing 13 (D), it acquires the red system division block which consisted of pixels (0) other than a red system 
pixel (1) or a red system pixel. And a microcomputer 70 asks for the index C2 which is the number of the red 
system division blocks which consisted of only red system pixels. 

[0080] A microcomputer 70 calculates the environmental complexity C according to the formula (1) mentioned 
above using the index C2 which shows the number of the index C1 which shows the number of the brightness 
division blocks searched for, and red system division blocks, and shifts to a step ST 23. In addition, the value of 
the complexity C calculated as mentioned above changes with time of day, as shown in drawin g 14 . 
[0081] In addition, an index C2 may not be limited to the number of red system division blocks, and the following 
values are sufficient as it. 

[0082] To the image pick-up image of a predetermined field, in Munsell color charts, a color chart may belong to 
2.5RP, 5RP, 7.5RP, 10RP, 2.5R, 5R, 7.5R and 10R, 2.5YR, and 5YR, and a microcomputer 70 may extract only the 
pixel of two or more chromas and a three or more lightness red system. And what is necessary is just to let the 
number of the division blocks with which the inside of the same division block repeated dividing the above- 
mentioned division block, and was obtained in it until only the above-mentioned red system pixel consisted of 
only pixels other than a red system pixel be an index C2. 

[0083] Moreover, to the image pick-up image of a predetermined field, in Munsell color charts, a color chart 
belongs to 2.5RP, 5RP, 7.5RP, 10RP, 2.5R, 5R, 7.5R and 10R, 2.5YR, and SYR, and a microcomputer 70 extracts 
only the pixel of two or more chromas and a three or more lightness red system, and is good also considering 
the number of the pixels of the above-mentioned red system as an index C2. Or it is good also considering total 
of the distance of each red system pixel mentioned above from the center of an image pick-up image as an 
index C2. 

[0084] At a step ST 23, a microcomputer 70 sets up the threshold th forjudging an environmental recognition 
degree. A threshold th is set up so that it may change with environmental illuminances of the car exterior. The 
reason is that it may sense that the traffic environment of a driver is complicated, or may sense that it is simple 
when it is bright in the car exterior or it becomes dark, even if the value of Complexity C is fixed. 
[0085] As shown in drawing 1 515 , the threshold table which described the threshold th over an environmental 
illuminance is memorized by the microcomputer 70. According to drawing 15 , a threshold th becomes large at a 
fixed rate as it becomes the minimum value (fixed) and an environmental illuminance becomes large from S1 to 
S2, when an environmental illuminance is from zero to S1. And a threshold th becomes small at a fixed rate as it 



■becorrfes maximum (fixed) and an environmental illuminance becomes large from S3, when an environmental 
illuminance is from S2 to S3. In addition, the threshold table shown in drawing 15 is an example of the gestalt of 
this operation, and this invention is not limited to this. 

[0086] Then, a microcomputer 70 sets up a threshold th with reference to the above-mentioned threshold table 
based on the environmental illuminance detected by the illuminance sensor 41. Furthermore, a microcomputer 70 
can reset the maximum of a threshold th according to posture change of the actuation input value of a driver, or 
a driver. 

[0087] First, a microcomputer 70 sets up the maximum of a threshold th according to the input value of a slider 
51 prepared in the slider panel 50. For example, when the driver is sliding the slider 51 to the direction of "a a 
little more than", as shown in drawing 15 , as for a microcomputer 70, the maximum of a threshold th is set up 
greatly. On the contrary, when the driver is sliding the slider 51 to the direction of "weakness", as for a 
microcomputer 70, the maximum of a threshold th is set up small. In addition, when there is a slider 51 in the 
middle of "a little more than" and "weakness", a microcomputer 70 is good with the default threshold th set up 
based on the environmental illuminance. 

[0088] Next, a microcomputer 70 sets up the maximum of a threshold th according to posture change of a driver. 
The reason is that a driver has the inclination to be easy to recognize various environments in the case where 
there is change of a posture frequently, and there is an inclination to be hard to recognize an environment, in the 
case where there is no change of a posture. Then, a microcomputer 70 sets up a threshold th as follows in 
consideration of the ease of carrying out of recognition of a traffic environment, and the relation of posture 
change of a driver. 

[0089] When it judges with posture change of a driver being "smallness" in the step ST 21 mentioned above, a 
microcomputer 70 sets up the maximum of a threshold th small, as shown in dravying 16 . When it judges with 
posture change of a driver being "size" in a step ST 21 conversely, the maximum of a threshold th is set up 
greatly. In addition, a microcomputer 70 is good with the default threshold th set up based on the environmental 
illuminance, when it judges with posture change of a driver being "inside." 

[0090] Thus, a microcomputer 70 will shift to a step ST 24, if a threshold th is further set up based on posture 
change of a driver with the threshold table on which the threshold th corresponding to an environmental 
illuminance was described, and the input value of a slider 51 prepared in the slider panel 50. 
[0091] At a step ST 24, a microcomputer 70 compares the complexity C calculated at a step ST 22 with the 
threshold th set up at a step ST 23, as shown in draw ing 1 7 . And when Complexity C is not over the threshold 
th, it judges with an environment being simple intricately. Moreover, when Complexity C is over the threshold th, 
it judges with an environment being complicated. 

[0092] In the case of front scenery as judged as a traffic environment being "simple" in the case of front 
scenery as the image pick-up image obtained with CCD camera 21 for obstruction photography shows to 
drawing 18 , for example, shown in drawing 19 , a traffic environment judges that a microcomputer 70 is 
"complicated." And subroutine processing is ended and it shifts to the step ST 3 shown in dr awi ng 3 . 
[0093] ((ST) Step 3) At a step ST 3, a microcomputer 70 performs the alarm of an obstruction to a driver. Here, 
it judges whether there is any alarm request flag for every field, and a predetermined alarm is performed to a 
driver using the high flag of priority. In addition, the alarm request flag said here means the flag which shows that 
it is necessary to perform an alarm to a driver by existence of an obstruction etc. about the above-mentioned 
predetermined field. And a microcomputer 70 specifically performs processing from the step ST 31 shown in 
drawing 20 R> 0 to a step ST 42. 

[0094] At a step ST 31, it judges whether a microcomputer 70 generates the alarm request flag of Field A. Here, 
the subroutine from the step ST 51 specifically shown in drawing 21 to a step ST 54 is performed. 
[0095] At a step ST 51, a microcomputer 70 judges whether the obstruction was detected in Field A, or a 
current self-vehicle location is in obstruction appearance within the limits, when fulfilling one of conditions, it 
shifts to a step ST 52, and when fulfilling neither of the conditions, subroutine processing is ended. 
[0096] At a step ST 52, a microcomputer 70 judges whether the self-vehicle has taken the evasive action to the 
obstruction based on the self-vehicle condition detected at the step ST 13 mentioned above, when having taken 
the evasive action, it shifts to a step ST 53, and when having not taken the evasive action, it ends subroutine 
processing. 

[0097] At a step ST 53, it judges whether as for a microcomputer 70, it is impossible for a self-vehicle to avoid 
an obstruction based on the information and the self-vehicle condition about the obstruction detected in a step 
ST 1. And though the driver stepped on the brake pedal, for example, or the handle was operated and the 
evasive action over an obstruction is taken, when a self-vehicle cannot avoid an obstruction, it shifts to a step 
ST 54, and subroutine processing is ended when a self-vehicle can avoid an obstruction. 

[0098] At a step ST 54, a microcomputer 70 generates the alarm request flag in Field A, and ends subroutine 
processing. A microcomputer 70 shifts to the step ST 32 shown in drawing 20 R> 0, after ending such subroutine 
processing. 



'[0099] At a step ST 32, it judges whether a microcomputer 70 generates an alarm request flag to each of Fields 
B, C. and D. Subroutine processing from the step ST 61 specifically shown in drawin g 22 to a step ST 64 is 
performed. In addition, since the same processing is performed in any field here, processing of Field B is 
mentioned as an example and explained. 

[0100] At a step ST 61, a microcomputer 70 judges whether the obstruction was detected in Field B, or a 
current self-vehicle location is in obstruction appearance within the limits, when fulfilling one of conditions, it 
shifts to a step ST 62, and when fulfilling neither of the conditions, subroutine processing is ended. 
[0101] At a step ST 62, the complexity C of Field B judges whether the threshold th was exceeded in whether it 
judged that Field B is complicated and a step ST 2 in the step ST 2 which mentioned the microcomputer 70 
above. And when the complexity C of Field B exceeds a threshold th, it shifts to a step ST 63, and subroutine 
processing is ended when it is not over the threshold th. 

[0102] At a step ST 63, a microcomputer 70 judges whether it is the location where the location of an 
obstruction or the obstruction appearance range emits an alarm for the first time, when it is the location which 
emits an alarm for the first time, it shifts to a step ST 64, and when it is not the location which emits an alarm 
for the first time, it ends subroutine processing. 

[0103] At a step ST 64, a microcomputer 70 generates the alarm request flag in Field B, and ends subroutine 
processing. A microcomputer 70 shifts to the step ST 33 shown in drawing 2020 , after ending the above 
subroutine processings. 

[0104] At a step ST 33, a microcomputer 70 judges whether there is any alarm request flag of Field A, when 
there is an alarm request flag of Field A, it shifts to a step ST 39, and when there is no alarm request flag of 
Field A, it shifts to a step ST 34. 

[0105] At a step ST 34, it judges whether a microcomputer 70 has the alarm request flag of Field C or Field D. 
And when an alarm request flag is at least in one side of each field, it shifts to a step ST 38, and when there is 
no alarm request flag in all of each field, it shifts to a step ST 35. 

[0106] At a step ST 35, it judges whether a microcomputer 70 has the alarm request flag of Field B, when there 
is an alarm request flag of Field B, it shifts to a step ST 36, and when there is no alarm request flag of Field B, 
subroutine processing is ended. 

[0107] Thus, a microcomputer 70 is performing processing in order of a step ST 33 to the step ST 35, sets up 
priority in order of Field A, Field C or Field D, and Field B, and is performing the alarm of an obstruction from the 
high field of priority. 

[0108] At a step ST 36, a microcomputer 70 judges whether there was any alarm request flag of Field A by the 
last judgment processing, when there is an alarm request flag of Field A, it shifts to a step ST 37, and when 
there is no alarm request flag of Field A, it ends subroutine processing. 

[0109] At a step ST 37, a microcomputer 70 performs the alarm of Field B to a driver. Notice a microcomputer 
70 about "forward cardiac failure theory object as an alarm to a driver," "a crossing is approached. Be careful of 
a pedestrian's elutriation. Display " etc. on LCD61, or it is made to output from a loudspeaker 62 with voice, and 
subroutine processing is ended. 

[01 10] Moreover, at the step ST 38 when judging with there having been one [ at least ] alarm request flag of 
Field C and Field D, and shifting at a step ST 34, a microcomputer 70 performs an alarm to a driver about a field 
with an alarm request flag. As an example of an alarm request, it is the same as that of a step ST 37. 
[01 1 1] At the step ST 39 when judging with there having been an alarm request flag of Field A, and on the other 
hand, shifting at a step ST 33, it judges whether there is any alarm request flag of Field A more than a 
predetermined number, and an alarm request flag shifts to a step ST 40 more than a predetermined number at a 
certain time, and when there is no alarm request flag more than a predetermined number, it shifts to a step ST 
42. 

[01 12] At a step ST 40, a microcomputer 70 judges whether the vehicle speed detected by the self-vehicle 
condition detecting element 30 is beyond a predetermined value, when the vehicle speed is beyond a 
predetermined value, it shifts to a step ST 41, and when the vehicle speed is not beyond a predetermined value, 
it shifts to a step ST 42. 

[01 13] At a step ST 41, a microcomputer 70 performs the 1st alarm in Field A to a driver. Microcomputers 70 
are for example, "collision cautions as the 1st alarm to a driver. Please slow down. Display " etc. on LCD61, or it 
is made to output from a loudspeaker 62 with voice, and subroutine processing is ended. 

[01 14] At a step ST 42, a microcomputer 70 performs the 2nd alarm in Field A to a driver. A microcomputer 70 
displays "please avoid an obstruction" etc. on LCD61, or is made to output from a loudspeaker 62 with voice as 
the 2nd alarm to a driver, and ends subroutine processing. 

[01 15] A microcomputer 70 ends the alarm to a driver, after ending subroutine processing of a step ST 3. Thus, 
a microcomputer 70 can prevent that control the alarm to a driver to the minimum, become a surfeit of 
information, and a driver gets confused by processing by setting priority as the alarm request flag of each field. 
[0116] As mentioned above, the obstruction alarm 1 concerning the gestalt of the 1st operation can make a 



'driver recognize a migration obstruction, without confusing a driver by recognizing a migration obstruction 
autQmatically, presuming the range of a migration obstruction which can be appeared, and taking into 
consideration the recognition degree of the traffic environment of a driver in the appearance location of a 
migration obstruction further. Moreover, when there is much amount of information which a driver should be 
shown, the obstruction alarm 1 can be urged that the vehicle speed of a self-vehicle is reduced, and can prevent 
accident beforehand. 

[01 1 7] When an obstruction is detected also in any of Field A to the field D shown in drawing J 0 , the 
obstruction alarm 1 gives top priority to the field A in front of a self-vehicle, and performs an alarm to the 
obstruction which exists in Field A. Thereby, the obstruction alarm 1 can avoid the crisis for which it pressed 
immediately before. 

[01 18] gestalt] of operation of others [ □ — below, the gestalt of other operations of this invention is explained. 
In addition, the sign same about the part which overlaps the gestalt of the 1st operation is attached, and detailed 
explanation is omitted. 

[01 19] (Mode of division of an image pick-up image) With the gestalt of the 1st operation As opposed to this 
which the microcomputer 70 divided the image pick-up field into four from Field A to Field D as shown in drawing 
10 , and was calculating the index C1 and the index C2 in Field B, Field C, and Field D A microcomputer 70 may 
divide into four fields the image pick-up image shown in drawing 2323 (A), as shown in drawing 23 (B). That is, 
the microcomputer 70 is dividing the image pick-up image into four fields by dividing a rectangle-like image pick- 
up image along with the two diagonal lines. And what is necessary is just to calculate an index C1 and an index 
C2 about each field like the gestalt of the 1 st operation. 

[0120] Moreover, a microcomputer 70 may divide into four fields of a field (1), two fields (2), and a field (3) the 
image pick-up image shown in dh^ywng_24 (A), as shown in drawing 24 (B). Here, a field (1) is a field which shows 
the car in front of Katanao in front of a self^vehicle. A field (2) is a field of both the outsides of a field (1). Fields 
(3) are fields other than a field (1) and a field (2). 

[0121] A microcomputer 70 can divide a brightness division block to 1x1 pixel about a field (1), can divide it to 
2x2 pixels about a field (2), can be divided to 2x2 pixels about a field (3), and can calculate an index C1 in each 
field. Furthermore, a microcomputer 70 can divide a red system division block to 1x1 pixel in each field, can 
obtain the image shown in drawing 24 (C), and can calculate an index C2 in each field. 

[0122] Furthermore, a microcomputer 70 can also divide an image pick-up image as follows. For example, as 
shown in drawing 25 R> 5, an image pick-up image may be divided into a "bottom of screen", "middle of the 
screen", a "screen left", and "the method of the screen right." A "bottom of screen" is the field of the shape of 
a rectangle from 5 to 1/4 about 1/of lengthwise directions of the image pick-up image bottom. "Middle of the 
screen" is a triangle-like field, one side of the triangle adjoins a "bottom of screen", and the vertical angle of 
one side is located in the upper limit of an image pick-up screen. A "screen left" is the field of left-hand side 
trapezoidal shape among fields other than a "bottom of screen" and "middle of the screen." "The method of the 
screen right" is the field of right-hand side trapezoidal shape among fields other than a "bottom of screen" and 
"middle of the screen." 

[0123] About middle of the screen, as shown in drayying 26 , you may divide further. 

[0124] (Setup of a threshold th) You may make it set up a microcomputer 70 according to each input value of 
not only when setting up a threshold th like the gestalt of the 1st operation according to the input value of the 
slider 51 operated by the driver individual, but the slider 51 operated by two or more drivers. 
[0125] Drawing 27 is drawing which plotted the environmental recognition degree inputted by the driver, when 
ten persons\driver is shown the image pick-up image often sheets. A microcomputer 70 can set up the 
appropriate threshold th by calculating the average of these values. 

[0126] (Other operation technique of Complexity C) A microcomputer 70 calculates Complexity C according to a 
formula (1), and although the environmental recognition degree was presumed by comparing Complexity C with a 
threshold th, this invention is not limited to this. 

[0127] A microcomputer 70 may memorize the recognition degree map in which the recognition degree 
determined by the index C1 and the index C2 is shown, as shown in drawing 28 R> 8. At this time, a 
microcomputer 70 calculates an index C1 and an index C2 like the gestalt of the 1st operation, and should just 
presume an environmental recognition degree with reference to the above-mentioned recognition degree map. 
For example, it can judge with it judging with an environmental recognition degree being high at the time of = (C1, 
C2) (a, b), and the environmental recognition degree of a microcomputer 70 being low when it is = (C1, C2) (c, d). 

[0128] (Three-dimension spacial configuration) A microcomputer 70 divides an image pick-up image into a 
predetermined field beforehand, calculates an index C1 and an index C2 like the gestalt of the 1st operation for 
every predetermined field, and calculates an index C1 and C2 further to it. And an index C1, an index C2, an 
index CI, and C2 can be arranged to three-dimension vector space, as shown in drawing 29 , and the value 
(magnitude, sense) of the movement vector on each pixel can also be used as complexity C. 



[0129]'The 1st field presumed that an environmental recognition degree is low and the 2nd field presumed that 
an environmental recognition degree is high may be prepared in three-dimension vector space so that it may be 
shown at this time, for example, drayyjng 30 . If a microcomputer 70 is judged and Complexity C is in the 1st field, 
it will presume that the degree of a driver of environmental recognition is low, and if Complexity C is in the 2nd 
field, it can presume it that the degree of environmental recognition is [ a driver ] high to any of the above- 
mentioned field the complexity C called for using the above-mentioned three-dimension space belongs. 
[0130] (Neural network) A microcomputer 70 may presume an environmental recognition degree using a neural 
network. D rawing 31 is the block diagram showing the functional configuration of the microcomputer 70 which 
presumes an environmental recognition degree using a neural network. 

[0131] The microcomputer 70 is equipped with the neural network 71 which consists of a transform function 
which has the database which can be updated, the recognition degree presumption section 72 which presumes 
the recognition degree of the environment of a driver, and the computing element 73 which performs processing 
which subtracts estimate from an input value. In addition, the computing element 73 which may be equipped with 
a learning function with a statistical method subtracts the estimate of the recognition degree of the environment 
presumed in the recognition degree presumption section 72 instead of a neural network 71 from the input value 
of the slider 51 shown in drawing 2 . A neural network 71 is serially learned based on the subtraction value 
subtracted by the computing element 73, and Complexity C, and supplies the complexity [ finishing / study ] C 
to the recognition degree presumption section 72. The recognition degree presumption section 72 should just 
presume an environmental recognition degree for every driver using the complexity [ finishing / the study from a 
neural network 71 ] C. 

[0132] Consequently, a microcomputer 70 can be serially learned in consideration of actual environmental , 
recognition of a driver, and can presume the recognition degree of a traffic environment correctly according to a 
driver individual's vision property. 
[0133] 

[Effect of the Invention] The environmental complexity arithmetic unit concerning this invention can ask for the 
complexity which shows the complexity of the difficulty of carrying out of environmental recognition, i.e., an 
environment, by calculating environmental complexity at least based on one side of distribution of change of the 
brightness contained in the image pick-up image generated with said image pick-up means, and distribution of 
the red system pixel contained in said image pick-up image. 

[0134] The environmental recognition degree presumption equipment concerning this invention can presume the 
recognition degree of an observer s environment objective and correctly by presuming an environmental 
recognition degree based on the complexity calculated with the complexity arithmetic unit. 
[0135] By performing the alarm about said obstruction, when it is presumed that the environmental recognition 
degree of the predetermined field which detects the location of an obstruction and includes the location of the 
detected obstruction is low, the obstruction alarm concerning this invention can carry out the alarm of the 
existence of the obstruction concerned to an observer, when an obstruction is in the low field of an 
environmental recognition degree. Since an alarm is not performed on the other hand when an obstruction is in 
the high field of an environmental recognition degree, an observer can prevent receiving troublesomeness with 
an excessive alarm. 
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TECHNICAL FIELD 



[Field of the Invention] This invention relates to an environmental complexity arithmetic unit, environmental 
recognition degree presumption equipment, and an obstruction alarm, and relates to the environmental 
complexity arithmetic unit, the environmental recognition degree presumption equipment and the obstruction 
alarm which offer obstruction recognition exchange of a driver especially according to the traffic environment of 
the perimeter of a car. 
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EFFECT OF THE INVENTION 

[Effect of the Invention] The environmental complexity arithmetic unit concerning this invention can ask for the 
complexity which shows the complexity of the difficulty of carrying out of environmental recognition, i.e., an 
environment, by calculating environmental complexity at least based on one side of distribution of change of the 
brightness contained in the image pick-up image generated with said image pick-up means, and distribution of 
the red system pixel contained in said image pick-up image. 

[0134] The environmental recognition degree presumption equipment concerning this invention can presume the 
recognition degree of an observer's environment objective and correctly by presuming an environmental 
recognition degree based on the complexity calculated with the complexity arithmetic unit. 
[0135] By performing the alarm about said obstruction, when it is presumed that the environmental recognition 
degree Q f the predetermined field which detects the location of an obstruction and includes the location of the 
detected obstruction is low, the obstruction alarm concerning this invention can carry out the alarm of the 
existence of the obstruction concerned to an observer, when an obstruction is in the low field of an 
environmental recognition degree. Since an alarm is not performed on the other hand when an obstruction is in 
the high field of an environmental recognition degree, an observer can prevent receiving troublesomeness with 
an excessive alarm. 
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TECHNICAL PROBLEM 



[Description of the Prior Art] In operation of a car, it is important to check elutriation from right and left in the 
time of rectilinear propagation of a car or to check a crossing object on either side to a travelling direction in the 
time of the right and left chip box of a car, when preventing accident. The mobile which jumps out of right and 
left, or is crossed can consider various things, such as a pedestrian, a two-flower vehicle, and a four-flower 
vehicle. 

[0003] In JP,3-260813,A, the environmental recognition equipment which detects such a mobile is proposed. 
Environmental recognition equipment acquired profile information by extracting the difference and the closed 
interval field of lightness information, and recognizes the migration body from profile information. However, since 
the lighting conditions which surround a car change every moment and have the influence of disturbance light 
etc., it is rare to be able to extract a profile completely vividly. Therefore, since the above-mentioned 
environmental recognition equipment performs image recognition only using profile information, its 
correspondence to an environmental variation from the little of amount of information is weak. In the case where 
it is carried in a car and an obstruction etc. is detected especially, since it is influenced [ which was mentioned 
above ] greatly, it is hard to say that a mobile is detectable the optimal. Moreover, since the lightness which was 
easy to be influenced of a shadow, disturbance light, etc., and changed with disturbance light affects change of a 
center of gravity or area directly, the processing which extracts a direct closed interval from lightness 
information is difficult. 

[0004] In addition, the detection technique which added internal information to profile information, such as 
template matching and texture matching, is also proposed. However, the processing time starts or there is a 
problem of taking the time and effort which prepares the huge information about a template beforehand. 
[0005] Under such a background, it is derived from the technique which compresses image information, and the 
technique of catching the image pick-up information on a camera with distribution of lightness data is proposed 
in recent years. 

[0006] In JP,1 1-142168A principal component analysis which is one of the multivariate analyses is performed, 
image pick-up information is mapped in the information space stretched with normalization principal component 
characteristic quantity, and the technique which improved the technique of carrying out image recognition is 
proposed by analyzing the behavior of the data in information space. This technique performs more robust 
environmental recognition for normalization principal component characteristic quantity using car movement 
information and actuation information. Moreover, in JP,2000-1 9259,A, the technique of recognizing a body using 
visible-ray image information and infrared image information other than the light is proposed. 

[0007] However, these techniques are difficult to recognize a mobile, when many factors which bar recognition of 
bodies, such as a guard rail and a halt vehicle, exist. For example, there is a problem which cannot recognize the 
pedestrian in the foot walks or crossings other than on [ through which a car passes ] a road surface, and the 
pedestrian who has run out of between the standby location of a bicycle or a halt vehicle. 

[0008] On the other hand, for example by JP,1 1-301343,A, the lighting system for cars which used not only the 
obstruction itself but the camera (light, infrared rays) and which predicts the appearance rate of a migration 
obstruction according to environmental (road configuration) recognition is proposed. Moreover, in JP,11- 
232569,A, the pedestrian alarm system with the equipment which sends to a vehicle side whether the pedestrian 
approached the crossing etc. is proposed. Furthermore, in JP,6-144129,A, the nudge assistant equipment which 
aims at a nudge by choosing at random one cautions item by which two or more preparation was carried out to 
the same condition of being careful, and reporting to a driver is proposed, without recognizing a migration 
obstruction positively. 

[0009] Thus, the migration obstruction recognition exchange which offers obstruction recognition exchange to a 
driver is proposed by performing approach warning of the thing in consideration of the automatic recognition of a 
migration obstruction, and the appearance probability of a migration body, or a pedestrian etc. 
[0010] However, finally the driver itself recognizes a migration obstruction. If the vision cognition of the driver 
and a cognitive property were not taken into consideration, since a lot of information was shown to the driver 
too much, a driver may be confused on the contrary. Moreover, although there are few amounts of information 



'presentation, they are inefficient. [ of the approach of uniting a cautions item with a location and showing it at 
random ] 

[001 1] This invention is proposed in order to solve the technical problem mentioned above, and it aims at 
offering the environmental complexity arithmetic unit, the environmental recognition degree presumption 
equipment, and the obstruction alarm which can offer obstruction recognition exchange efficiently and exactly, 
without showing a driver superfluous information. 
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MEANS 

[Means for Solving the Problem] Invention according to claim 1 is equipped with a complexity operation means to 
calculate environmental complexity, at least based on one side of distribution of change of the brightness 
contained in the image pick-up image generated with an image pick-up means to generate an image pick-up 
image based on the image pick-up light from an environment and said image pick-up means, and distribution of 
the red system pixel contained in said image pick-up image. 

[0013] As for an image pick-up means, in invention according to claim 1, it is desirable to be installed so that a 
front traffic environment may be picturized for example, from a car front seat. A complexity operation means can 
ask for the spatial frequency which shows the complexity of an image from distribution of brightness change 
included in an image pick-up image. Moreover, a complexity operation means can ask for the complexity of an 
image from distribution of the red system pixel contained in an image pick-up image. 

[0014] Invention according to claim 2 is set to invention according to claim 1. Said complexity operation means 
Until it sets a brightness division block as the image pick-up image generated with said image pick-up means and 
it is judged in the set-up brightness division block that the brightness value of each pixel is homogeneous It 
repeats dividing said brightness division block and setting up a new brightness division block, and is 
characterized by calculating environmental complexity to said image pick-up image based on the number of the 
brightness division blocks with which the brightness value of each pixel became homogeneity. 
[0015] In invention according to claim 2, a complexity operation means sets up a brightness division block to an 
image pick-up image. The brightness division block set up first shows the field which calculates complexity. And 
said brightness division block is divided, the divided brightness division block is set up as a new brightness 
division block, and this processing is repeated until it is judged in a brightness division block that the brightness 
value of each pixel is homogeneous. Here, the difference of the maximum of not only when the brightness value 
of each pixel is in agreement in the brightness value of each pixel being homogeneous, but a brightness value 
and the minimum value of a brightness value should just be below a predetermined value. Namely, dispersion in 
the brightness value of each pixel has just become below a predetermined value. 

[0016] And if it is judged that the brightness value of each pixel in all brightness division fields is homogeneous, 
it will ask for the number of these the brightness division blocks of all as environmental complexity. The number 
of such brightness division blocks supports spatial frequency. That is, if there are many totals, there are many 
high frequency components and an image pick-up image is complicated. Moreover, if there are few totals, there 
are few high frequency components and the image pick-up image is simple. Thus, it can ask for environmental 
complexity by asking for the number of brightness division blocks. 

[0017] Invention according to claim 3 is set to invention according to claim 1. Said complexity operation means 
Until it sets a red system division block as the image pick-up image generated with said image pick-up means 
and the set-up red system division block consists of only predetermined red system pixels It repeats dividing 
said red system division block and setting up a new red system division block, and is characterized by calculating 
environmental complexity to said image pick-up image based on the number of the red system division blocks 
which consist of only said predetermined red system pixels. 

[0018] In invention according to claim 3, a complexity operation means sets up a red system division block to an 
image pick-up image. The red system division block set up first shows the field which calculates complexity. The 
red system division block concerned is divided until a red system division block consists of only predetermined 
red system pixels. And the divided red system division block is set up as a new red system division block, and 
this processing is repeated. If all red system division blocks consist of only predetermined red system pixels, it 
will ask for the number of these the red system division blocks of all as environmental complexity. Red is 
compared green, and has the property that eye attractiveness is high, and, as for the number of red system 
division blocks, the complexity of an image is shown. Therefore, it can ask for environmental complexity by 
calculating the number of the above-mentioned red system division blocks. 

[0019] Invention according to claim 4 is set to invention according to claim 1. Said complexity operation means 
Until it sets a brightness division block as the image pick-up image generated with said image pick-up means and 
it is judged in the set-up brightness division block that the brightness value of each pixel is homogeneous 



' Repeat dividing said brightness division block and setting up a new brightness division block, and said image 
pick-up image is received. Until it calculates the number of the brightness division blocks with which the 
brightness value of each pixel became homogeneity, it sets a red system division block as the image pick-up 
image generated with said image pick-up means and the set-up red system division block consists of only 
predetermined red system pixels Repeat dividing said red system division block and setting up a new red system 
division block, and said image pick-up image is received. It is characterized by calculating the number of the red 
system division blocks which consist of only said predetermined red system pixels, and calculating environmental 
complexity based on the number of said brightness division blocks, and the number of red system division blocks. 

[0020] In invention according to claim 4, a complexity operation means asks for the number of brightness division 
blocks like invention according to claim 2, asks for the number of red system division blocks like invention 
according to claim 3 further, and asks for environmental complexity based on these totals. It is desirable to 
square a respectively predetermined weighting multiplier to the product of the number of brightness division 
blocks, the number of red system division blocks, the number of brightness division blocks, and the number of 
red system division blocks, and to ask for these total as environmental complexity, at it. 

[0021] Invention according to claim 5 is equipped with an environmental recognition degree presumption means 
to presume an environmental recognition degree based on the complexity calculated with the complexity 
arithmetic unit and said complexity arithmetic unit of four given in any 1 term from claim 1. 

[0022] In invention according to claim 5, since the complexity of an environmental image pick-up image is shown, 
the complexity calculated with the complexity arithmetic unit is used as a parameter for presuming the 
recognition degree of an observer s environment. That is, an environmental recognition degree presumption 
means can presume an environmental recognition degree based on the above-mentioned complexity. 
[0023] It is characterized by presuming that the environmental recognition degree of invention according to claim 
6 is low in invention according to claim 5 when the complexity which calculated said environmental recognition 
degree presumption means with said complexity arithmetic unit is beyond a threshold, and presuming that an 
environmental recognition degree is high when the complexity calculated with said complexity arithmetic unit is 
smaller than a threshold. 

[0024] In invention according to claim 6, the threshold used as the reference value of an environmental 
recognition degree is set up. That is, a threshold is a value of the complexity which shows simple middle that an 
environment is complicated. Then, it presumes that the environmental recognition degree of an environmental 
recognition degree presumption means is low when complexity is beyond a threshold in using this threshold, and 
when complexity is smaller than a threshold, it can be presumed that an environmental recognition degree is 
high. 

[0025] It is characterized by equipping invention according to claim 7 with an illuminance detection means to 
detect an environmental illuminance, further in invention according to claim 5 or 6, and for said environmental 
recognition degree presumption means setting up said threshold corresponding to the illuminance detected by 
said illuminance detection means, and presuming an environmental recognition degree using the set-up 
threshold. 

[0026] In invention according to claim 7, even if complexity is fixed, when it is bright in the car exterior or it 
becomes dark, an observer may sense that an environment is complicated or may sense that it is simple. Then, 
in order to amend change of the recognition degree of the environment by change of such an illuminance, it is 
desirable to use the threshold table on which the threshold corresponding to an illuminance was described 
beforehand. Thereby, if an illuminance is detected by the illuminance detection means, the threshold 
corresponding to the detected illuminance can be set up. And an environmental recognition degree can be 
presumed using the set-up threshold. Consequently, no matter an illuminance may be what value, an 
environmental recognition degree can be presumed correctly. 

[0027] Invention according to claim 8 is further equipped with a posture change detection means to detect 
posture change of an observer in invention of seven given in any 1 term from claim 5. Said environmental 
recognition degree presumption means It is characterized by presuming an environmental recognition degree 
using the threshold which set up the threshold greatly as posture change of an observer detected with said 
posture change detection means became large, set up the threshold small and was set up as posture change of 
an observer detected with said posture change detection means became small. 

[0028] In invention according to claim 8, an observer has the degree which recognizes an environment in a high 
inclination, when posture change is large. By setting up a threshold greatly as posture change of an observer 
becomes large, and setting up a threshold small as posture change of an observer becomes small, an 
environmental recognition degree presumption means can presume an environmental recognition degree 
correctly so that it may agree in an observer's actual vision property. 

[0029] The environmental recognition degree presumption equipment of eight given in any 1 term from claim 5 
invention according to claim 9 presumes an environmental recognition degree to be for every predetermined 



1 field, When a predetermined field including the location of the obstruction detected with an obstruction location 
detection means to detect the location of an obstruction, and said obstruction detection means is presumed 
that an environmental recognition degree is low by said environmental recognition degree presumption means, it 
has an alarm means to perform the alarm about said obstruction. 

[0030] In invention according to claim 9, an obstruction location detection means detects the location of an 
obstruction. At this time, environmental recognition degree presumption equipment presumes the recognition 
degree of the environment of a predetermined field including the location where the obstruction was detected. 
Here, when an environmental recognition degree is high, an observer can recognize enough the obstruction 
detected by the obstruction location detection means. On the other hand, when an environmental recognition 
degree is low, an observer may be unable to recognize the obstruction detected by the obstruction location 
detection means. Then, an alarm means performs the alarm about an obstruction, when it is presumed that the 
environmental recognition degree of a predetermined field including the location of an obstruction is low. 
Thereby, even when an obstruction is in the field where an environmental recognition degree is low, an observer 
can recognize in advance that there is an obstruction and can avoid accident. In addition, when it is presumed 
that the environmental recognition degree of the predetermined [ an observer can be made to call attention 
when an alarm means outputs an image or voice ] field in which an alarm means includes the location of an 
obstruction again is high, the alarm about an obstruction is not performed. Thereby, in the case where an 
obstruction is in the field where an environmental recognition degree is high, since an observer can recognize 
the obstruction, he does not receive troublesomeness with an excessive alarm. 

[0031] Invention according to claim 10 is set to invention according to claim 9. Said environmental recognition 
degree presumption equipment The field except the lower part of an image pick-up image is divided into two or 
more presumed fields, and an environmental recognition degree is presumed for every divided presumption field. 
Said alarm means When the location of the obstruction detected by said obstruction location detection means is 
in any of said presumed field and the recognition degree of the environment of the presumed field concerned is 
presumed to be low by said environmental recognition degree presumption means It is characterized by 
performing the alarm about the obstruction which exists in the high presumed field of a priority. 
[0032] In invention according to claim 10, environmental recognition degree presumption equipment divides the 
field except the lower part of an image pick-up image into two or more presumed fields, and presumes an 
environmental recognition degree for every divided presumption field. That is, an environmental recognition 
degree is not presumed about the lower part of an image pick-up image. The lower part of an image pick-up 
screen shows the image of the environment in front of an observer, and the reason is that there is no semantics 
which presumes the degree of recognition of the environment. 

[0033] It judges whether an alarm means has the location of the obstruction detected by said obstruction 
location detection means in any of said presumed field, and the recognition degree of the environment of the . 
presumed field concerned was presumed to be low by said environmental recognition degree presumption means. 
Here, an obstruction is detected and an environmental recognition degree chooses all low presumption fields. 
And the alarm of a purport with which an obstruction exists is performed about the high presumed field of a 
priority among the selected appointed fields. While big accident is avoidable by making an observer careful of the 
thereby most dangerous field, about the field which is not not much dangerous, it can prevent an observer 
becoming a surfeit of information and getting confused by not reporting to an observer. 
[0034] 

[Embodiment of the Invention] It explains to a detail, referring to a drawing about the gestalt of desirable 
operation of this invention hereafter. 

[0035] The gestalt of operation of the 1st of [gestalt of the 1st operation] this invention is applicable to the 
obstruction alarm 1 of a configuration of being shown in drawing 1 . The obstruction alarm 1 the infrastructure 
information which detects infrastructure information from the infrastructure of the car exterior The 
infrastructure information detecting element 10, The obstruction information detecting element 20 which detects 
a road and the information about the obstruction of the circumference of it, The self-vehicle condition detecting 
element 30 which detects the operating state of a self-car, and the environmental-information detecting 
element 40 which detects the environment of a driver or the car exterior, It has the slider panel 50 for inputting 
the vision property which shows the degree of environmental recognition of a driver, the obstruction information 
output section 60 which outputs obstruction information, and the microcomputer 70 which controls the whole 
based on the information detected in each part. 

[0036] The infrastructure information detecting element 10 is equipped with the GPS receiving circuit 11 which 
receives a GPS (Global PositioningSystem) signal, the DVD drive 12 which reads the map information currently 
recorded on the DVD disk, and the approach information receiving circuit 13 which receives approach 
information. 

[0037] The GPS receiving circuit 1 1 receives the GPS signal which has the positional information of time of day 
and a GPS Satellite through GPS antenna 1 1a, and supplies it to a microcomputer 70 through a data bus 5. 



Based on the positional information which is carrying out current transit, a car reads map information from a 
DVD.disk, and supplies the DVD drive 12 to a microcomputer 70 through a data bus 5. The approach information 
receiving circuit 1 3 receives the approach information transmitted from the data carrier reader mentioned later, 
and supplies it to a microcomputer 70 through a data bus 5. 

[0038] The obstruction information detecting element 20 is equipped with CCD camera 21 for obstruction 
photography for photoing the obstruction of a path on the street or the perimeter of a road, the infrared camera 
22 for photoing the obstruction of a path on the street or the perimeter of a road with infrared radiation, and the 
radar transceiver 23 for recognizing a forward cardiac failure theory object. 

[0039] CCD camera 21 for obstruction photography and the infrared camera 22 are installed so that the body of 
the direction of the car front can be picturized. And CCD camera 21 for obstruction photography and the 
infrared camera 22 supply the photoed photography image to a microcomputer 70 through a data bus 5. A radar 
transceiver 23 receives the optical radar reflected by the obstruction while extracting a pulse-like optical radar 
keenly to the obstruction concerned and transmitting in the two-dimensional direction, in order to recognize a 
forward cardiac failure theory object, in addition, a radar transceiver 23 may be a thing which does not restrict, 
but transmits and receives an electric-wave radar and which transmits and receives an optical radar. 
[0040] The self-vehicle condition detecting element 30 is equipped with for example, a wheel speed sensor, a 
steering angle sensor, a xhrottle-valve sensor, the master cylinder oil pressure sensor, the yaw rate sensor, the 
order acceleration sensor, the lateral acceleration sensor, etc. And the self-vehicle condition detecting element 
30 detects the vehicle speed, a handle steering include angle, an accelerator control input, the amount of brakes 
operation, a yaw rate, a roll rate, a pitch rate, order acceleration, lateral acceleration, and a winker control input, 
and supplies them to a microcomputer 70. 

[0041] The environmental-information detecting element 40 is equipped with the illuminance sensor 41 which 
detects the illuminance of the car exterior, and CCD camera 42 for driver photography which photos a driver. 
Here, although only one CCD camera 42 for driver photography is formed, three CCD cameras which picturize 
the method of forward presence of a driver, the method of the forward right, and the method of the forward left, 
respectively may be formed so that posture change of a driver can be detected easily. 
[0042] The slider panel 50 is for carrying out the actuation input of the vision property which shows the 
complexity of an external environment according to the subjectivity of a driver. As shown in the slider panel 50 
and drawing 2 , it has the movable slider 51 right and left. A driver operates a slider 51 in the direction of 
"weakness", when he tends to overlook the traffic environment (i.e., when judging that it is hard to recognize the 
traffic environment of the car exterior). Moreover, a driver operates a slider 51 in the direction of "a little more 
than", when a traffic environment can be seen well (i.e., when it is easy to recognize the traffic environment of 
the car exterior). Although this mentions later in detail, a microcomputer 70 can presume an environmental 
recognition degree in consideration of the present vision property of a driver. 

[0043] The obstruction information output section 60 is equipped with LCD (Liquid Crystal Display)61 which 
outputs obstruction information with an image, and the loudspeaker 62 which outputs obstruction information 
with voice. 

[0044] The microcomputer 70 is constituted by CPU (Central Processing Unit) which is not illustrated, RAM 
(Random Access Memory) which is the work area of data, and ROM (Read Only Memory) the program and 
appearance range presumption table which perform various kinds of routine processings mentioned later, and the 
threshold table are remembered to be. A microcomputer 70 presumes an obstruction with appearance possibility 
based on the information from each part, presumes the environmental recognition degree of a driver, or performs 
the alarm of obstruction information. 

[0045] (Main routine) In the obstruction alarm 1 constituted as mentioned above, a microcomputer 70 performs 
processing from the step ST 1 shown in drawing 3 to a step ST 3. Here, processing from a step ST 1 to a step 
ST 3 is explained briefly first, and the concrete subroutine of each processing is explained after that. 
[0046] A microcomputer 70 presumes the obstruction which may appear in the travelling direction of a self- 
vehicle while detecting a self-vehicle location based on the information detected by the infrastructure 
information detecting element 10 (step ST 1). And the environmental recognition degree which shows whether 
the image pick-up image of the environment of the travelling direction of a self-vehicle is divided, and it is easy 
to recognize a driver for every divided field is presumed (step ST 2). Finally, a microcomputer 70 performs the 
alarm about an obstruction to a driver if needed based on obstruction information with appearance possibility, 
and the environmental recognition degree for every predetermined field with an image or voice (step ST 3). 
[0047] ((ST) Step 1) At a step ST 1, a microcomputer 70 performs processing from the step ST 1 1 specifically 
shown in drawing 4 to a step ST 14 that the obstruction which may appear in the travelling direction of a self- 
vehicle should be presumed. 

[0048] At a step ST 1 1, a microcomputer 70 is the circumference of a self-vehicle location, and detects the 
migration obstruction outside the field-of-view range of a driver while it detects the location of a self-vehicle. In 
addition, an infrastructure which is explained below, for example is used here. 



' [0049]' For example, as shown in draw ing 5 , the pedestrian is always carrying the goods (for example, cellular 
phone) with which the data carrier 1 6 was formed. Moreover, the data carrier 1 6 is formed in the two-flower 
vehicle or the four-flower vehicle. A data carrier 16 can output some kinds of approach information, and the data 
carrier 16 of a pedestrian, a two-flower vehicle, and a four-flower vehicle outputs approach information different, 
respectively. On the other hand, the data carrier reader 1 7 which receives approach information is installed in 
the bad crossing and bad zebra zone of a prospect. If a data carrier 16 approaches, the data carrier reader 17 
will receive approach information, and will transmit this approach information to the obstruction alarm 1. 
[0050] If the approach information transmitted from the data carrier reader 17 is received in the approach 
information receiving circuit 13, the microcomputer 70 of the obstruction alarm 1 can pinpoint the location of an 
obstruction, and can recognize any of a pedestrian, a two-flower vehicle, and a four-flower vehicle the 
obstruction is further. 

[0051] And a microcomputer 70 is the circumference of a self-vehicle location, detects the migration 
obstruction outside the field-of-view range of a driver, and recognizes the classification (a man, a two flower 
vehicle, or a four flower vehicle) of the migration obstruction concerned while it detects the location of a self- 
vehicle based on the GPS signal received by the GPS receiving circuit 1 1 , the map information read from the 
DVD drive 12, and the approach information received by the approach information receiving circuit 13. 
[0052] Furthermore, a microcomputer 70 presumes the range where a migration obstruction on the street 
[ around a self-vehicle ] may appear based on the classification of a migration obstruction with reference to the 
appearance range presumption table shown in drawing 6 R> 6. For example, when the four-flower vehicle has 
been recognized as a migration obstruction, the four-flower vehicle concerned presumes that a microcomputer 
70 may appear in a travelling direction within the limits of 10m from a current location. Moreover, when the 
pedestrian has been recognized as a migration obstruction, the pedestrian concerned presumes that it may 
appear in within the limits with a radius of 1 m from the current position. 

[0053] A microcomputer 70 sets up the system of coordinates (henceforth "self-vehicle circumference system 
of coordinates") which consist of a shaft which intersects perpendicularly with the travelling direction shaft and 
travelling direction shaft of a self^vehicle, describes the appearance possibility range of a migration obstruction 
to self-vehicle circumference system of coordinates, and shifts to a step ST 12. 

[0054] At a step ST 12, a microcomputer 70 detects the obstruction in field-of-view within the limits of a driver. 
Here, a microcomputer 70 makes CCD camera 21 for obstruction photography, and the infrared camera 22 drive, 
and acquires the image pick-up image generated with CCD camera 21 for obstruction photography, and the 
infrared camera 22. And a migration obstruction is detected by obtaining the image which fully attached contrast 
for human being who poses a problem especially on insurance, or a vehicle with the other thing by asking for the 
difference of the image generated with each camera. 

[0055] Moreover, based on the both-way time amount of the optical radar from transmission by the radar 
transceiver 23 to reception, a microcomputer 70 obtains the depth map of the forward cardiac failure theory 
object of a self-vehicle, and recognizes a forward cardiac failure theory object. A microcomputer 70 describes 
the migration obstruction recognized by doing in this way to self-vehicle circumference system of coordinates, 
and shifts to a step ST 1 3. 

[0056] At a step ST 13, a microcomputer 70 detects a self-vehicle condition based on the information from the 
self-vehicle condition detecting element 30. Here, a microcomputer 70 detects the vehicle speed, a handle 
steering include angle, an accelerator control input, the amount of brakes operation, a yaw rate, a roll rate, a 
pitch rate, order acceleration, lateral acceleration, and a winker control input, presumes the travelling direction 
of a self^vehicle, describes the presumed result of the travelling direction of a self-vehicle to self-vehicle 
circumference system of coordinates, and shifts to a step ST 14 as indicated by JP,1 1-301343A for example. 
[0057] At a step ST 14, a microcomputer 70 leaves only the information on a migration obstruction that it may 
appear in advance prediction within the limits of a self-vehicle, to the self-vehicle circumference system of 
coordinates obtained by processing from a step ST 1 1 to a step ST 13, and removes the information on other. 
And if a microcomputer 70 is displayed on LCD61 by using as an obstruction display screen information about 
the migration obstruction described by self-vehicle circumference system of coordinates, it will shift to the step 
ST 2 which escaped from the subroutine and was shown in drawing_3_ . 

[0058] Here, the obstruction display screen shows the map of the perimeter the self-vehicle is running, the 
current position of a self-vehicle, the advance prediction range of a self-vehicle, and migration obstructions 
(people, vehicle, etc.) and the range of those which can be appeared, as shown in drawing 7 . The magnitude of 
the migration obstruction displayed on the obstruction display screen shows the range where the migration 
obstruction concerned may appear. 

[0059] ((ST) Step 2) At a step ST 2, a microcomputer 70 performs processing from the step ST 21 specifically 
shown in drawing 8 to a step ST 24 that the degree a driver recognizes a perimeter [ car ] environment to be 
should be presumed. 

[0060] At a step ST 21, a microcomputer 70 detects change of the posture of a driver using the information 



from the environmental-information detecting element 40. namely, the microcomputer 70 — the image pick-up 
image from CCD camera 42 for driver photography — inter-frame [ every ] — difference — asking — the 
difference of an image pick-up image — a value is detected as migration space quantity of a driver. 
[0061] A microcomputer 70 counts "1", when migration space quantity is beyond a predetermined threshold, and 
when migration space quantity is smaller than a predetermined threshold, it does not count. And the counted 
value concerned is one or more thresholds TH, the counted value for the past 5 minutes is calculated, for 
example, when the counted value concerned is less than one threshold TH, it judges with posture change being 
"smallness", when it is under the threshold TH2 0 TH1), it judges with posture change being "insside'',jand when 
the counted value concerned is two or more thresholds TH, it judges with posture change being "size." 
Moreover, a microcomputer 70 acquires the illuminance of the car exterior detected by the illuminance sensor 
41, and shifts to a step ST 22. 

[0062] At a step ST 22, a microcomputer 70 calculates the environmental complexity C for every predetermined 
field of the obstruction display screen shown in drawing 7 . In addition, the complexity C said here means the 
parameter used in order to presume the recognition degree of the traffic environment of a driver. 
[0063] First, a microcomputer 70 quadrisects the field which has an obstruction and its range which can be 
appeared among the obstruction display screens obtained at a step ST 1 in distance and a direction. Here, as 
shown in drawing 9 , the obstruction display screen is divided into Field A, Field B, Field C, and Field D. Thereby, 
the above-mentioned obstruction display screen adjoins Field A and Field A which are a field of the front 
transverse-plane short distance of a self-vehicle, adjoins Field B and Fields A and B which are fields of a front 
transverse-plane long distance of a self-vehicle, adjoins Field C and Fields A and B which are fields of a front 
left long distance of a self-vehicle, and has the field D which is a field of a front right long distance of a self- 
vehicle. In addition, from the obstruction display screen field A, typically. Field D is divided, as shown in drawing 
10 . 

[0064] Next, a microcomputer 70 calculates the complexity C of a traffic environment about each of Field B, 
Field C, and Field D based on the following formula (1). 
[0065] 
[Equation 1] 

C - a- C1+ C2+ y C\C2 (1) 

[0066] An index C1 shows the number of brightness division blocks, and the index C2 shows the number of red 
system division blocks. Moreover, alpha, beta, and gamma are weighting multipliers and take a predetermined 
value, respectively. 

[0067] Here, the operation of an index C1 is explained. In addition, although a microcomputer 70 calculates an 
index C1 about Field B, Field C, and Field D as mentioned above, it explains calculating an index C1 using the 4 
image pick-up image shown in drawing 1 1 about Field B here. 

[0068] A microcomputer 70 obtains an image pick-up image as made drive CCD camera 21 for obstruction 
photography, for example, shown in drawing 1 1 . And the whole image pick-up image concerned is set up as a 
brightness division block. 

[0069] A microcomputer 70 calculates the difference of the maximum of the brightness value of each pixel, and 
the minimum value in the set-up brightness division block. A microcomputer 70 judges whether they are the 
maximum of a brightness value, and beyond a threshold predetermined in the difference of the minimum value, 
and when the above-mentioned difference is over the predetermined threshold, it divides a brightness division 
block into four. At this time, as for a microcomputer 70, it is desirable to divide a brightness division block so 
that it may consist of almost same numbers of pixels in every direction, and so that it may enlarge as much as 
possible. 

[0070] When the brightness value of an image pick-up image shows drawing 12 (A), a microcomputer 70 
calculates the difference of the maximum (180) of a brightness value, and the minimum value (000). And since it 
judged whether the difference (180) of the maximum of a brightness value and the minimum value was beyond a 
threshold (for example, 40) and the above-mentioned difference is over the threshold (40) here, as shown in 
drawing 12 (A), a brightness division block is divided into four. 

[0071] A microcomputer 70 divides said brightness division block into four, and repeats setting up a new 
brightness division block until the difference of the maximum of the brightness value of each pixel and the 
minimum value becomes below a predetermined threshold in each divided brightness division block. 
[0072] For example, the brightness division block BK1 shown in drawing 12 (A) consists of 4x4 pixels, and the 
minimum value of 180 and a brightness value of the maximum of a brightness value is 20. A microcomputer 70 
searches for the difference (160) of the maximum of the brightness value of the brightness division block BK1, 
and the minimum value, and since the above-mentioned difference is beyond a threshold (40), as shown in 
dravwitl2 (B), it divides the brightness division block BK1 into four (BK2, BK3, BK4, BK5). 

[0073] And since the difference (39) of the maximum of the brightness value of the brightness division block BK2 



and the minimum value is not beyond a threshold (40), a microcomputer 70 does not divide to the brightness 
division block BK2. On the other hand, about the brightness division blocks BK3, BK4, and BK5, since the 
difference of the maximum of a brightness value and the minimum value is beyond a threshold (40), as shown in 
drawing 1212 (C), each brightness division block BK is divided. 

[0074] Passing through such processing, a microcomputer 70 asks for the index C1 which shows the number of 
the brightness division blocks with which the difference of the maximum of the brightness value of each pixel 
and the minimum value became below a predetermined threshold (40). Thereby, a microcomputer 70 makes 
homogeneity the brightness value of each pixel which constitutes a brightness division block. 
[0075] In addition, an index C1 is not limited to the number of brightness division blocks which became the 
maximum of the brightness value of each pixel, and below a threshold predetermined in the difference of the 
minimum value. For example, an index C1 may be the variance of the brightness value of an image pick-up image. 
Moreover, an index C1 may be total of the high frequency component of the two-dimensional fast Fourier 
transform (FFTrFast Fourier Transform) of an image pick-up image. 

[0076] Moreover, as shown in drawing 12 R> 2 (C), it divided until the brightness division block BK became 1x1 
pixel, but a microcomputer 70 may end division, when it becomes the magnitude (for example, 4x4 pixels) which 
divided the brightness division block BK and was defined beforehand. 

[0077] Below, the operation of an index C2 is explained. In addition, although C2 which indicates that the number 
of red system division blocks mentioned the microcomputer 70 above for every predetermined field is calculated, 
it explains calculating an index C2 about Field B using the image pick-up image shown in drawing 13 (A) here. 
[0078] A microcomputer 70 obtains an image pick-up image as made drive CCD camera 21 for obstruction 
photography, for example, shown in drawing 13 (A). And an image pick-up image as extracted 0.3 or more 
lightness and 0.1 or more saturation from the image pick-up image concerned, for example, shown in drawing 
1313 (B) is obtained. Furthermore, a microcomputer 70 will obtain an image pick-up image as shown in drawing 
13 (C), if 0.1 or less and 0.75 or more hues are extracted. 

[0079] To an image pick-up image as shown in drawing 13 (C), a microcomputer 70 repeats block division so that 
the inside of the same red system division block may occupy only by the red system pixel, and as shown in 
draw ing 13 (D), it acquires the red system division block which consisted of pixels (0) other than a red system 
pixel (1) or a red system pixel. And a microcomputer 70 asks for the index C2 which is the number of the red 
system division blocks which consisted of only red system pixels. 

[0080] A microcomputer 70 calculates the environmental complexity C according to the formula (1) mentioned 
above using the index C2 which shows the number of the index C1 which shows the number of the brightness 
division blocks searched for, and red system division blocks, and shifts to a step ST 23. In addition, the value of 
the complexity C calculated as mentioned above changes with time of day, as shown in drawing 14 . 
[0081] In addition, an index C2 may not be limited to the number of red system division blocks, and the following 
values are sufficient as it. 

[0082] To the image pick-up image of a predetermined field, in Munsell color charts, a color chart may belong to 
2.5RP, 5RP, 7.5RP, 10RP, 2.5R, 5R, 7.5R and 10R, 2.5YR, and 5YR, and a microcomputer 70 may extract only the 
pixel of two or more chromas and a three or more lightness red system. And what is necessary is just to let the 
number of the division blocks with which the inside of the same division block repeated dividing the above- 
mentioned division block, and was obtained in it until only the above-mentioned red system pixel consisted of 
only pixels other than a red system pixel be an index C2. 

[0083] Moreover, to the image pick-up image of a predetermined field, in Munsell color charts, a color chart 
belongs to 2.5RP, 5RP, 7.5RP, 10RP, 2.5R, 5R, 7.5R and 10R, 2.5YR, and 5YR, and a microcomputer 70 extracts 
only the pixel of two or more chromas and a three or more lightness red system, and is good also considering 
the number of the pixels of the above-mentioned red system as an index C2. Or it is good also considering total 
of the distance of each red system pixel mentioned above from the center of an image pick-up image as an 
index C2. 

[0084] At a step ST 23, a microcomputer 70 sets up the threshold th forjudging an environmental recognition 
degree. A threshold th is set up so that it may change with environmental illuminances of the car exterior. The 
reason is that it may sense that the traffic environment of a driver is complicated, or may sense that it is simple 
when it is bright in the car exterior or it becomes dark, even if the value of Complexity C is fixed. 
[0085] As shown in drawing 1 515 , the threshold table which described the threshold th over an environmental 
illuminance is memorized by the microcomputer 70. According to drawing 15 , a threshold th becomes large at a 
fixed rate as it becomes the minimum value (fixed) and an environmental illuminance becomes large from S1 to 
S2, when an environmental illuminance is from zero to S1. And a threshold th becomes small at a fixed rate as it 
becomes maximum (fixed) and an environmental illuminance becomes large from S3, when an environmental 
illuminance is from S2 to S3. In addition, the threshold table shown in drawin g 15 is an example of the gestalt of 
this operation, and this invention is not limited to this. 

[0086] Then, a microcomputer 70 sets up a threshold th with reference to the above-mentioned threshold table 



based on the environmental illuminance detected by the illuminance sensor 41. Furthermore, a microcomputer 70 
can .reset the maximum of a threshold th according to posture change of the actuation input value of a driver, or 
a driver. 

[0087] First, a microcomputer 70 sets up the maximum of a threshold th according to the input value of a slider 
51 prepared in the slider panel 50. For example, when the driver is sliding the slider 51 to the direction of "a a 
little more than", as shown in drawing 15 , as for a microcomputer 70, the maximum of a threshold th is set up 
greatly. On the contrary, when the driver is sliding the slider 51 to the direction of "weakness", as for a 
microcomputer 70, the maximum of a threshold th is set up small. In addition, when there is a slider 51 in the 
middle of "a little more than" and "weakness", a microcomputer 70 is good with the default threshold th set up 
based on the environmental illuminance. 

[0088] Next, a microcomputer 70 sets up the maximum of a threshold th according to posture change of a driver. 
The reason is that a driver has the inclination to be easy to recognize various environments in the case where 
there is change of a posture frequently, and there is an inclination to be hard to recognize an environment, in the 
case where there is no change of a posture. Then, a microcomputer 70 sets up a threshold th as follows in 
consideration of the ease of carrying out of recognition of a traffic environment, and the relation of posture 
change of a driver. 

[0089] When it judges with posture change of a driver being "smallness" in the step ST 21 mentioned above, a 
microcomputer 70 sets up the maximum of a threshold th small, as shown in drawing 1 6 . When it judges with 
posture change of a driver being "size" in a step ST 21 conversely, the maximum of a threshold th is set up 
greatly. In addition, a microcomputer 70 is good with the default threshold th set up based on the environmental 
illuminance, when it judges with posture change of a driver being "inside." 

[0090] Thus, a microcomputer 70 will shift to a step ST 24, if a threshold th is further set up based on posture 
change of a driver with the threshold table on which the threshold th corresponding to an environmental 
illuminance was described, and the input value of a slider 51 prepared in the slider panel 50. 
[0091] At a step ST 24, a microcomputer 70 compares the complexity C calculated at a step ST 22 with the 
threshold th set up at a step ST 23, as shown in drawin g 1 7 . And when Complexity C is not over the threshold 
th, it judges with an environment being simple intricately. Moreover, when Complexity C is over the threshold th, 
it judges with an environment being complicated. 

[0092] In the case of front scenery as judged as a traffic environment being "simple" in the case of front 
scenery as the image pick-up image obtained with CCD camera 21 for obstruction photography shows to 
drawing 18 , for example, shown in drawing 19 , a traffic environment judges that a microcomputer 70 is 
"complicated." And subroutine processing is ended and it shifts to the step ST 3 shown in drawing 3 . 
[0093] ((ST) Step 3) At a step ST 3, a microcomputer 70 performs the alarm of an obstruction to a driver. Here, 
it judges whether there is any alarm request flag for every field, and a predetermined alarm is performed to a 
driver using the high flag of priority. In addition, the alarm request flag said here means the flag which shows that 
it is necessary to perform an alarm to a driver by existence of an obstruction etc. about the above-mentioned 
predetermined field. And a microcomputer 70 specifically performs processing from the step ST 31 shown in 
drayyjng 20 R> 0 to a step ST 42. 

[0094] At a step ST 31, it judges whether a microcomputer 70 generates the alarm request flag of Field A. Here, 
the subroutine from the step ST 51 specifically shown in drawing 21 to a step ST 54 is performed. 
[0095] At a step ST 51, a microcomputer 70 judges whether the obstruction was detected in Field A, or a 
current self-vehicle location is in obstruction appearance within the limits, when fulfilling one of conditions, it 
shifts to a step ST 52, and when fulfilling neither of the conditions, subroutine processing is ended. 
[0096] At a step ST 52, a microcomputer 70 judges whether the self^vehicle has taken the evasive action to the 
obstruction based on the self-vehicle condition detected at the step ST 13 mentioned above, when having taken 
the evasive action, it shifts to a step ST 53, and when having not taken the evasive action, it ends subroutine 
processing. 

[0097] At a step ST 53, it judges whether as for a microcomputer 70, it is impossible for a self-vehicle to avoid 
an obstruction based on the information and the sel^vehicle condition about the obstruction detected in a step 
ST 1. And though the driver stepped on the brake pedal, for example, or the handle was operated and the 
evasive action over an obstruction is taken, when a self-vehicle cannot avoid an obstruction, it shifts to a step 
ST 54, and subroutine processing is ended when a self-vehicle can avoid an obstruction. 
[0098] At a step ST 54, a microcomputer 70 generates the alarm request flag in Field A, and ends subroutine 
processing. A microcomputer 70 shifts to the step ST 32 shown in drawing 20 R> 0, after ending such subroutine 
processing. 

[0099] At a step ST 32, it judges whether a microcomputer 70 generates an alarm request flag to each of Fields 
B, C, and D. Subroutine processing from the step ST 61 specifically shown in drawin g 22 to a step ST 64 is 
performed. In addition, since the same processing is performed in any field here, processing of Field B is 
mentioned as an example and explained. 



' [0100] At a step ST 61, a microcomputer 70 judges whether the obstruction was detected in Field B, or a 
current self-vehicle location is in obstruction appearance within the limits, when fulfilling one of conditions, it 
shifts to a step ST 62, and when fulfilling neither of the conditions, subroutine processing is ended. 
[0101] At a step ST 62, the complexity C of Field B judges whether the threshold th was exceeded in whether it 
judged that Field B is complicated and a step ST 2 in the step ST 2 which mentioned the microcomputer 70 
above. And when the complexity C of Field B exceeds a threshold th, it shifts to a step ST 63, and subroutine 
processing is ended when it is not over the threshold th. 

[0102] At a step ST 63, a microcomputer 70 judges whether it is the location where the location of an 
obstruction or the obstruction appearance range emits an alarm for the first time, when it is the location which 
emits an alarm for the first time, it shifts to a step ST 64, and when it is not the location which emits an alarm 
for the first time, it ends subroutine processing. 

[0103] At a step ST 64, a microcomputer 70 generates the alarm request flag in Field B, and ends subroutine 
processing. A microcomputer 70 shifts to the step ST 33 shown in Awmgj2O20 , after ending the above 
subroutine processings. 

[0104] At a step ST 33, a microcomputer 70 judges whether there is any alarm request flag of Field A, when 
there is an alarm request flag of Field A, it shifts to a step ST 39, and when there is no alarm request flag of 
Field A, it shifts to a step ST 34. 

[0105] At a step ST 34, it judges whether a microcomputer 70 has the alarm request flag of Field C or Field D. 
And when an alarm request flag is at least in one side of each field, it shifts to a step ST 38, and when there is 
no alarm request flag in all of each field, it shifts to a step ST 35. 

[0106] At a step ST 35, it judges whether a microcomputer 70 has the alarm request flag of Field B, when there 
is an alarm request flag of Field B, it shifts to a step ST 36, and when there is no alarm request flag of Field B, 
subroutine processing is ended. 

[0107] Thus, a microcomputer 70 is performing processing in order of a step ST 33 to the step ST 35, sets up 
priority in order of Field A, Field C or Field D, and Field B, and is performing the alarm of an obstruction from the 
high field of priority. 

[0108] At a step ST 36, a microcomputer 70 judges whether there was any alarm request flag of Field A by the 
last judgment processing, when there is an alarm request flag of Field A, it shifts to a step ST 37, and when 
there is no alarm request flag of Field A, it ends subroutine processing. 

[0109] At a step ST 37, a microcomputer 70 performs the alarm of Field B to a driver. Notice a microcomputer 
70 about "forward cardiac failure theory object as an alarm to a driver," "a crossing is approached. Be careful of 
a pedestrian's elutriation. Display " etc. on LCD61, or it is made to output from a loudspeaker 62 with voice, and 
subroutine processing is ended. 

[01 10] Moreover, at the step ST 38 when judging with there having been one [ at least ] alarm request flag of' 
Field C and Field D, and shifting at a step ST 34, a microcomputer 70 performs an alarm to a driver about a field 
with an alarm request flag. As an example of an alarm request, it is the same as that of a step ST 37. 
[01 1 1] At the step ST 39 when judging with there having been an alarm request flag of Field A, and on the other 
hand, shifting at a step ST 33, it judges whether there is any alarm request flag of Field A more than a 
predetermined number, and an alarm request flag shifts to a step ST 40 more than a predetermined number at a 
certain time, and when there is no alarm request flag more than a predetermined number, it shifts to a step ST 
42. 

[01 12] At a step ST 40, a microcomputer 70 judges whether the vehicle speed detected by the self-vehicle 
condition detecting element 30 is beyond a predetermined value, when the vehicle speed is beyond a 
predetermined value, it shifts to a step ST 41, and when the vehicle speed is not beyond a predetermined value, 
it shifts to a step ST 42. 

[01 13] At a step ST 41, a microcomputer 70 performs the 1st alarm in Field A to a driver. Microcomputers 70 
are for example, "collision cautions as the 1st alarm to a driver. Please slow down. Display " etc. on LCD61, or it 
is made to output from a loudspeaker 62 with voice, and subroutine processing is ended. 

[01 14] At a step ST 42, a microcomputer 70 performs the 2nd alarm in Field A to a driver. A microcomputer 70 
displays "please avoid an obstruction" etc. on LCD61, or is made to output from a loudspeaker 62 with voice as 
the 2nd alarm to a driver, and ends subroutine processing. 

[01 15] A microcomputer 70 ends the alarm to a driver, after ending subroutine processing of a step ST 3. Thus, 
a microcomputer 70 can prevent that control the alarm to a driver to the minimum, become a surfeit of 
information, and a driver gets confused by processing by setting priority as the alarm request flag of each field. 
[0116] As mentioned above, the obstruction alarm 1 concerning the gestalt of the 1st operation can make a 
driver recognize a migration obstruction, without confusing a driver by recognizing a migration obstruction 
automatically, presuming the range of a migration obstruction which can be appeared, and taking into 
consideration the recognition degree of the traffic environment of a driver in the appearance location of a 
migration obstruction further. Moreover, when there is much amount of information which a driver should be 



' shown, the obstruction alarm 1 can be urged that the vehicle speed of a self-vehicle is reduced, and can prevent 
accident beforehand. 

[01 17] When an obstruction is detected also in any of Field A to the field D shown in drawing 10 , the 
obstruction alarm 1 gives top priority to the field A in front of a self-vehicle, and performs an alarm to the 
obstruction which exists in Field A. Thereby, the obstruction alarm 1 can avoid the crisis for which it pressed 
immediately before. 

[01 18] gestalt] of operation of others [ D — below, the gestalt of other operations of this invention is explained. 
In addition, the sign same about the part which overlaps the gestalt of the 1st operation is attached, and detailed 
explanation is omitted. 

[01 19] (Mode of division of an image pick-up image) With the gestalt of the 1st operation As opposed to this 
which the microcomputer 70 divided the image pick-up field into four from Field A to Field D as shown in drawing 
10 , and was calculating the index C1 and the index C2 in Field B, Field C, and Field D A microcomputer 70 may 
divide into four fields the image pick-up image shown in drawing 2 323 (A), as shown in drawing 23 (B). That is, 
the microcomputer 70 is dividing the image pick-up image into four fields by dividing a rectangle-like image pick- 
up image along with the two diagonal lines. And what is necessary is just to calculate an index C1 and an index 
C2 about each field like the gestalt of the 1 st operation. 

[0120] Moreover, a microcomputer 70 may divide into four fields of a field (1), two fields (2), and a field (3) the 
image pick-up image shown in drawing 24 (A), as shown in drawing 24 (B). Here, a field (1) is a field which shows 
the car in front of Katanao in front of a self-vehicle. A field (2) is a field of both the outsides of a field (1). Fields 
(3) are fields other than a field (1) and a field (2). 

[0121] A microcomputer 70 can divide a brightness division block to 1x1 pixel about a field (1), can divide it to 
2x2 pixels about a field (2), can be divided to 2x2 pixels about a field (3), and can calculate an index C1 in each 
field. Furthermore, a microcomputer 70 can divide a red system division block to 1x1 pixel in each field, can 
obtain the image shown in drawing 24 (C), and can calculate an index C2 in each field. 

[0122] Furthermore, a microcomputer 70 can also divide an image pick-up image as follows. For example, as 
shown in drawing 25 R> 5, an image pick-up image may be divided into a "bottom of screen", "middle of the 
screen", a "screen left", and "the method of the screen right." A "bottom of screen" is the field of the shape of 
a rectangle from 5 to 1/4 about 1/of lengthwise directions of the image pick-up image bottom. "Middle of the 
screen" is a triangle-like field, one side of the triangle adjoins a "bottom of screen", and the vertical angle of 
one side is located in the upper limit of an image pick-up screen. A "screen left" is the field of left-hand side 
trapezoidal shape among fields other than a "bottom of screen" and "middle of the screen." "The method of the 
screen right" is the field of right-hand side trapezoidal shape among fields other than a "bottom of screen" and 
"middle of the screen." 

[0123] About middle of the screen, as shown in drawing 26 , you may divide further. 

[0124] (Setup of a threshold th) You may make it set up a microcomputer 70 according to each input value of 
not only when setting up a threshold th like the gestalt of the 1st operation according to the input value of the 
slider 51 operated by the driver individual, but the slider 51 operated by two or more drivers. 
[0125] Drawing 27 ' s drawing which plotted the environmental recognition degree inputted by the driver, when 
ten persons' driver is shown the image pick-up image of ten sheets. A microcomputer 70 can set up the 
appropriate threshold th by calculating the average of these values. 

[0126] (Other operation technique of Complexity C) A microcomputer 70 calculates Complexity C according to a 
formula (1), and although the environmental recognition degree was presumed by comparing Complexity C with a 
threshold th, this invention is not limited to this. 

[0127] A microcomputer 70 may memorize the recognition degree map in which the recognition degree 
determined by the index C1 and the index C2 is shown, as shown in dr awing 28 R> 8. At this time, a 
microcomputer 70 calculates an index C1 and an index C2 like the gestalt of the 1st operation, and should just 
presume an environmental recognition degree with reference to the above-mentioned recognition degree map. 
For example, it can judge with it judging with an environmental recognition degree being high at the time of = (CI, 
C2) (a, b), and the environmental recognition degree of a microcomputer 70 being low when it is = (CI, C2) (c, d). 

[0128] (Three-dimension spacial configuration) A microcomputer 70 divides an image pick-up image into a 
predetermined field beforehand, calculates an index C1 and an index C2 like the gestalt of the 1st operation for 
every predetermined field, and calculates an index C1 and C2 further to it. And an index CI, an index C2, an 
index CI, and C2 can be arranged to three-dimension vector space, as shown in drawing 29 , and the value 
(magnitude, sense) of the movement vector on each pixel can also be used as complexity C. 
[0129] The 1st field presumed that an environmental recognition degree is low and the 2nd field presumed that 
an environmental recognition degree is high may be prepared in three-dimension vector space so that it may be 
shown at this time, for example, drawing 30 . If a microcomputer 70 is judged and Complexity C is in the 1st field, 
it will presume that the degree of a driver of environmental recognition is low, and if Complexity C is in the 2nd 



field, it can presume it that the degree of environmental recognition is [ a driver ] high to any of the above- 
mentioned field the complexity C called for using the above-mentioned three-dimension space belongs. 
[0130] (Neural network) A microcomputer 70 may presume an environmental recognition degree using a neural 
network. Pravying 31 is the block diagram showing the functional configuration of the microcomputer 70 which 
presumes an environmental recognition degree using a neural network. 

[0131] The microcomputer 70 is equipped with the neural network 71 which consists of a transform function 
which has the database which can be updated, the recognition degree presumption section 72 which presumes 
the recognition degree of the environment of a driver, and the computing element 73 which performs processing 
which subtracts estimate from an input value. In addition, the computing element 73 which may be equipped with 
a learning function with a statistical method subtracts the estimate of the recognition degree of the environment 
presumed in the recognition degree presumption section 72 instead of a neural network 71 from the input value 
of the slider 51 shown in drawing 2 . A neural network 71 is serially learned based on the subtraction value 
subtracted by the computing element 73, and Complexity C, and supplies the complexity [ finishing / study ] C 
to the recognition degree presumption section 72. The recognition degree presumption section 72 / should just 
presume an environmental recognition degree for every driver using the complexity [ finishing / the study from a 
neural network 71 ] C. 

[0132] Consequently, a microcomputer 70 can be serially learned in consideration of actual environmental 
recognition of a driver, and can presume the recognition degree of a traffic environment correctly according to a 
driver individual's vision property. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawing 1] It is the block diagram showing the configuration of the obstruction alarm concerning the gestalt of 
operation of this invention. 

[Dr awin g 2] It is drawing showing the configuration of the slider panel with which the obstruction alarm was 
equipped. 

[ Drawing 3] It is the flow chart which shows the main routine of the operations sequence of the microcomputer 
with which the obstruction alarm was equipped. 

[Drawing 4] It is the flow chart which shows the concrete operations sequence of the step ST 1 in a main 
routine. 

[Drawing 5] It is drawing for explaining the outline of a data carrier and a data carrier reader. 

[ Drawing 6] It is drawing showing the appearance range presumption table memorized by the microcomputer. 

[Drawing_7] It is drawing showing the obstruction display screen displayed on LCD. 

[Dra wi ng 8] It is the flow chart which shows the concrete operations sequence of the step ST 2 in a main 
routine. 

[Drawing 9] It is drawing explaining the condition of having divided the obstruction display screen into Field D 
from Field A. 

[ Drawing 10] It is drawing explaining the condition of having divided the obstruction display screen into Field D 
from Field A typically. 

[Dra wing 1 1] It is drawing showing an example of the image pick-up image when calculating an index C1 in Field 
B. 

[Drawing 1 2] It is drawing showing an example of the brightness value of an image pick-up image. 

[Drawing 1 3] It is drawing showing an example of an image pick-up image. 

[Drawing 14] Complexity C is drawing explaining the condition of changing with time of day. 

[Drawing 15] It is drawing showing the threshold table on which the threshold over an environmental illuminance 
was described. 

[ Drawing 16] It is drawing explaining the condition that a threshold th changes according to posture change of a 
driver. 

[D raw ing 17] It is drawing for comparing Complexity C with a threshold th and presuming an environmental 
recognition degree. 

[Pravying 18] A traffic environment is drawing showing an example of a simple landscape image. 
[Drawing 19 ] A traffic environment is drawing showing an example of a complicated landscape image. 
[Drawing 20] It is the flow chart which shows the concrete operations sequence of the step ST 3 in a main 
routine. 

[Drawing 21] It is the flow chart which shows the concrete operations sequence of the step ST 31 in a 
subroutine. 

[ Dra wing 22] It is the flow chart which shows the concrete operations sequence of the step ST 32 in a 
subroutine. 

[Drayying 23] It is drawing for explaining other technique of division of an image pick-up image. 
[Drav;miK^4] It is drawing for explaining other technique of division of an image pick-up image. 
[Drawing 25] It is drawing for explaining other technique of division of an image pick-up image. 
[Drawing 26] It is drawing showing an example of division of middle of the screen. 

[Drawing 27] When ten persons' driver is shown the image pick-up image of ten sheets, it is drawing which 
plotted the environmental recognition degree inputted by the driver. 

[D rawing 28] It is drawing showing the recognition degree map in which the recognition degree determined by the 
index C1 and the index C2 is shown. 

[Drawing 29] It is drawing showing the three-dimension vector space which consists of an index CI, an index C2, 
an index C1, and C2. 

[Drawing 30] It is drawing explaining the condition of having prepared the 1st field presumed an environmental 



recognition degree being low and the 2nd field presumed an environmental recognition degree being high in 
three-dimension vector space. 

[Prawing_31_] It is the block diagram showing the functional configuration of the microcomputer which presumes 
an environmental recognition degree using a neural network. 
[Description of Notations] 
1 Obstruction Alarm 

10 Infrastructure Information Detecting Element 
20 Obstruction Information Detecting Element 
40 Environmental-Information Detecting Element 
60 Obstruction Information Output Section 
70 Microcomputer 
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[0 0 6 4] &"W^n^ea-^70H 

[0 0 6 5] 
»1] 



(1) 

^BKm4X4 mmxm& £ *u ^t^«^f» 

18 0, A£f(Of/jNg»:2 0"CfcSo W^oa^tr 
— $ 7 0 tt, 3@S^fJ^n y^BKl C0#S1g^*^ 
*£*/htt*>£ (16 0) ±B£**IMI (4 

o) £LL-e&s<£>-e. mi 2 (B) id^-TJ: Aft 

^D5/^BK1$:40 (BK2, BK3, BK4, 
BK5) ld#W?-5 0 

[0 0 7 3] ^LT, ^^n^^fa^70fj:, * 

(39) nmm (40) ^_l-c#v><dx\ »s#«y:/n 

^o-/^BK3, BK4, BK5t£o^Tfcfc, jj$MI<£> 

^Mtg/J^coHttBlM (4 0) eiJL-e&S*)-?, H 
12 (C) lc&rj:5lc, MWdMM^oy^BKfcd- 

[0 0 7 4] rOi^^Mt, ^^oraVtfa. 

7 oil ^SXoMftflE^A^flE^A/JMiott^R 
£cogHi (4 0) fiJlTlC^ofti^A^W^ny^©** 

7 0 J*, n y ^ Sr**i-S#ii?*03B|« 

[0 0 7 5] fc*5 x m^c 1 i* v #®§£<D*3&M<0§* 

^^©«tc:Kft$n«fe^"Ctt<cv\ 0H;ttf> (Wei 

iwcin Jt«Pi^o2^5ci«^-y^m (ff 

T:Fast Fourier Transfor m) 

[0 0 7 6] T-f ^n=2>-fc^ — ? 7 Ote, (§} 1 

2 (C) lC^i-«fc5K, WtdH^By^BKiUxi 

#JLT^tf>££>fc±££ (#J;ttf> 4X41^) ICfto 

[0077] off:, ^C2«Itco^tmt 

So ^*5, -v-f^n^^t: 0 ^ — 7 Ofi, ±iELfccfc^ 
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BWH-*. 

[0078] w^D 3 ytw7 0[t mwrnrnm 
fficcD*^ 7 2 1 &mW)£i£< m^tm 1 3 (a) ic 

^-J:5ft»*iil«*»5. ^UT, MfK«£*tfca>e> 
i^SO. *«0. m±S:ttailT, #J;itf0 

13 (B) Jc^J^ft^gffl&^tS. £*>K:. -r-r 
^U3y^^^70^ 0. XSlTXnO. 7 5J£JLL 

ofeffi*»ffl-rair, 013 (o ic7f;-t± 0 tmmm 

[00 7 9] K?*( fuzi — ? 7 0 te, 013 

(C) f^-t-«fc5^«lfe®«(C^bT, pa-G>*fi36# 

3SU 013 (D) 
* (1) XfiSfe^iii*^*^®* (0) 

ny^o»-efcS««C2«r*ai)5, 

[0 0 8 0] -^>f ^oaVfcT* — * 7 0tt % J&frbfrtz 

oy^K/Ttll«C2^^ ±3eLfc* (1) 
l^ot»liIC^ IT, 7fy7'ST23 

[00 8 1] ft*5. ^C2fi, 

[0 0 8 2] ^^0 3^^-^7 0(1 9fCofl« 

5RP, 5RP, 7. 5 R P, 10RP, 2. 5 R, 5 
R, 7. 5R, 10R, 2. 5YR, 5YRCIU * 

[0 0 8 3-] -7^^n3yt:V-^70ft Efj£ 

a*2. 5RP, 5 R P, 7. 5RP, 10RP, 2. 5 
R, 5R, 7. 5R, 10R, 2. 5YR, 5YRldJEi 
U ^n^2J^_h x ^S3tX±<7)^^cD®j^(Z)^^ 

[0 0 8 4] 2/yST2 3m ^^D^yfc'a 
-^7 0 fi % MHKR«ltt-fr»fl»r^^«oM« t h £ 



mot^, M^A^ffie^oX: 9 BlKftofc 91- 
St, K7^^tt«iSS«*s«*ti:«Cfe9*«t«i: 

[oo 8 5] ? v =i>-t°^—? 7 o^n^ wix.\-£m 

fcSHSx— ^/^^|a^g$^^TV^5o 01 5t-J:a<b, B3 

(-3© £ft9, iSIWssi^S2*^f</j: 
S^oT-£o£^^*#<ft£ 0 tLt, Mth 

^ofij^rvh$<^5o ft*>\ ii sic/Ttllf-^ 

[0 0 8 6] -?Tw-C, -7>fi7nayfa-^7 0ll ± 

[0 0 8 7] SflHC W^Pnyt'a-^ 7 012, * 

0 1 5 (c^-T<fc 9 ^*f^ u^i/foL— ^ 7 Oli 
Mttt h <KJ£-t-3 0 K9-f'*# 

Wtfe-TZo ft*5* ^7-f^5i^ r^j £ r^j <d*p^ 

[0 0 8 8]fc^^onytW70H K9 

^>*©S»8MLtasc-c\ suit h^i^t 
fbd5 ft ^titii £rfgn uc < v *«fa*s IhZfrbx 

[0 0 8 9] ^ u — ^ 7 0 13. ^x.^±3z^ 

r/hj 0 1 6t^i-«t 

«t hco*^c<i[«r/h^<K:fti-S. 5SSlc^ m*M^v 
7 P ST2im>TK7^/^^W -CfcS 

[00 90] r<^<t9tC x W^O3Xt'a^70 
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[0 0 9 1] *5*y:/S T 2 4-e^ x -^-f ^n^yfa 

— * 7 Oft, Hi 7(C^f «fc ^fy^ST2 2T 

KMt h<!:£tt:igfci-£o tLT, **8ftca*W« t h «: 

[0092] -^-r^ci^^b: 0 ^-^ 7 or*. mwvom& 
fficcD*y72 i-e#bttfc««u«^«xtf^i 8 

&mmm& mm] r*>st*u*i-5. ^it, 

t^fyM^Ttt, |g|3tc^-r^-r >^ST 
3 \z&'if+Z>o 

[00 93] U7yyST3) ^^5/>^ST3-eri. 

0C^7y/ST3 l^f)^777 P ST4 2*"C<D 
[0 0 9 4] ^y^STS ITU ^^na^fcTa 

/ST5 1 d»fc^r y^S T 5 4 * ^W-f y«r 

[0 0 9 5] ^75/7*ST5 l"Cfi, ^-f^nzi^tf^ 

aft© e rotoumssrticfes ***** u 

[0 0 9 6] ^7^/315 2^1 -^^nnvt: 0 ^ 

— ^70^ ±^Ufc^x^^ST 1 3-CttW$tLfci 

[0 0 9 7] ^fyT'STSSm -r^^czi^fcfzL 



[0 0 9 8] ^7$/yST54TH ^^na^ a 

0(:^77^st 3 2\z.Wu~r^o 

[0 0 9 9] ^7^^ST3 2m W^nytV 
112 21:^7^/816 l^f)^75/yST6 4 3; 

[0 10 0] ^s/^STe l-Ctt, W^nayt'a 

[0101] 77y^ST 6 2m ^^nay^a 
— *7 0te x ±^bfc^X^^ST2iCjoV^T^BJi 

[0 10 2] ^f^^ST 6 3TI1 ^^cny^ 

[0 10 3] ^7y7*ST6 4m W ^n=3^t e ^ 

2 0(:^7S/7 P ST3 3 \CWft-TZ> a 
[0 10 4] ^7iy^ST3 3Tfl ? n =3 v fc 0 3. 

— * 7 0H WAOtMSM7?^«)S^«rfy 
JtU WWA^SEailffll^^^dSfcofcir^tt^^y/ 
ST3 9lC»fTU ^ArofiM7 7 ^^/j:^ofc 
tff^7^ST3 4\cmf'f2>o 
[0105] ^fy^STS 4Tli, ^^^nn^t 0 ^ 
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[0106] ^ry/STS W^on^^a 

ST 3 6lC9*TU WBO|WS»77^^ofc 
[0 10 7] r<£>£?K:> ^ nayfa-^ 7 0 
«r»rrS£*-t\ M*A, WCXI1«*D, ffl«B 

[0 10 8] 7ry^ST3 W^nnytfa 
#fcofc*>ft«|*U f*A(D»«l!|77^fcofc 

[0 10 9] 7r^^ST3 7-Cfi. -^^^dn^tfoL 
-^70^ K^^C^S£BO*^£?T9o -^-T^D 

=ivtr^-^ 7 ofi. K?>r b-c, 

^LCD6 1 Icm^Z^tc*) , ^{C£VX\?~$6 2 
[0 1 10] £fc. ^7y^ST3 4Tfi|cC, SligcD 

fi> ^f^ST3 7tlitfe§. 
[0111] — 7rs'7 P ST3 3T|iA(OfiI 

fi^f^ST4 0lc»ffU ««5l»7 9^iS9f*jR 
[0 112] ^r^ysT4 otii, ^^tuy^ 

^&V^#te;*^;y:/ST4 2\Z.WfT~tZ>o 

[0 113] Xfy^ST4 ITU v>f^nnytV 
-^7 011 K7>f^*M>-C«l*A{C*5lt5»l»« 

v\ J ^LCD6ll:*^tfc5, #W-J:!9^ 

[0 114] ^T5/7'ST4 2m.^^U3y^ 
-*7 0te, K^>f^^UT««A{C*3tt5»2*a 
*rfT3 0 v^^P^ytV-^ 7 OH K9>f^C«i" 



l\> J /^^LCD6 iK^£ii:fc«9. ^^£9* 
[0 1 15) v>f^P3yea-^70ll X^-y^S 

[0 116] J^_b<7) J: 5> il^WWai 

tSr^aot, K 7 >r 9 
»iMK7^/<«$«rt^tf5o 

[0117] B»4MF«»1S 1 te> 010 K** bfc«* 
Ad>fe««DOV^ni^v^t>I»*«»«r*aufc»^ 
KH g*ttiro««A£*«teU ««A 

gin ii:t(Hciaofcft««r|gI»-t-Sr4:dS-C#5. . 

[oils] im<Dnm<DMffi] *isw©mo 
[0119] («&©^o##jof£tfai) « i *>**<z>tis 

f^TH W ^ oa^tr*— ^ 7 Oil Ell Oi^^-Tct 

««««S:««Ad>?>fll*D*-<?04olc^« 
U ««B. ««C&tf««Dtc*3V^»«RC l&tWi 

2 3 (A) (H2 3 (B) £ 9 

iC4 0<D^tC^SiJUTt> Xl\ o£?>, -^-r^an^ 
t?^-* 7 0 r±, 2 oo^il: 

^oTM«^^aor, Wt^400^C 

[0 12 0] &tc, ^4 ? n^yt°a-^ 7 0 H #R 
ti|g|2 4 (A) \Z7j*-rWL&ffi#L&s M2 4 (B) t£^-f 

.t^ic mm (i) , 2mmm (2) „ o> o 

4o©«*lc»#JU"Ct>J:^. «« (1) H 

g*<D«r^ii:«ro<Lp5^i-««-e*>6. «« (2) 

Wc. «* (1) OP5^HW©«Bgrt*>«. «« (3) il 
«* (1) Rtf&m. (2) ^fi-CfcSo 

[0121] ^-{?t2Z2 Vt°OL — ^ 7 0^, (1) 
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«K (2) icov>tfi2x2i**-e^«u ^« 

1 x 1IB**-C»f(ur, E12 4 (c) IC3j*i-f»«r» 
[0 12 2] W^nnytW 7 Oft, jt 

5 fci^i- J; 5 SMfciiHfe£r r@®TBj > i"®®* 
r®®T£Bj te, !Wfciii«oTfflJo»^iRi#5ii/5*»b 

[0123] iSffi**fc:o^-ctt, m 2 6 <fc 9 

[0 12 4] (SM t h <7>fS:£) D=n>b°^-^ 

7 of*. *l©*Jfe^«©«t5ic. K9>r>*«Afc:«fc 

[0125] 027 tt, 1 o^coK^^ici otfccojf 
Ifeiiift^ti^bfc^lc, K^/<lcj:oTA;ft£*xfc 

[0 12 6] (^$i^C(7)fife^lL^) W^nny 
t!\*-*7 0fi, ^ (1) »c^or««ia[CSr*»U 

[0 12 7] W^naytfa-^ 7 0 JS. «^«IS2 

v>f^nnyfc^^7 0{l H 1 CDHJfeO 
»«ira«fcUr*WCl&l«B«C2«r«»U ±15 

«fc</\, 0H£fr£, W^n^fcTa — * 7 Ott. (CI, 
C2) = (a, b) ottri^o^aS^iiSv^ir^J 

£U (CI, C2) = (c, d) cOtt^^CO^ 
[0 12 8] Oft^MEIS) ^^DnybV-^ 

mioHJ6^«^^«^«ci2ia««ic2fe 
u $ e>t-, ««c 1 • c 2 * it, 



*«cci, mmc2, mmci »c2^ 029^1- 

[0129] Z<Dt%. ®\*L&m3 0\Z7F-f£o\Z^ 3 

$g2<Dmmk*mfxi>&\,\ = #7 

Of*. ±IB3»C7C^KIS:fflv^*«)bttfc*»t«C3dS± 
[0 13 0] (— a— h) T^tiay^ 
[0 13 1] ^-f ^navtr* — *7 0«, 3E*r«TIBfc 

h7 lOffcbflK. «59fW^«fe*c: <fc or ^S«flB%«^L 

. 7 2 $ Hfc^co^a^^^) 

*i3£«*«»i-S 0 ~~ — =7>V*y h71lt ^»§i7 

*«u *w»^©««i«c*»ittA-g4tftaj7 2ic 

»^S««^Sr«3Stti,tf J: V \ 
[0 13 2] Z<Df&^ v^^puyfa-^ 7 Oft. 

[0 13 3] 

[0 13 4] 4c»m(c«diBHmMK'frttKKC». « 
[0 13 5] *M[CffSW«f««fttl» t ^w^o 
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«fc o xmt> L£&$:ttZ>Z£ &&5±~r 

[04] > ^ V/l^-f Vtfett y T 1 

[i6] W^navfcT* — ^IC|B*$ttfcWa«H«l 

[0 8] *4>-^--?->lC*ortZ>XTiyZfST2<DM:fc 

[09] »#«i*^®ffi*flB«A36^««DJJ:»WUfe 
«MB«rRWIi-SH"e*>a. 
[ilO] B»*«j^^iiiffiSr«^:«j«3:«*Ad»b«*D 

[Ull] WBtfSSIC 1 

[012] »fe®&<D*9£*g£>— 03&^i-0-Cfc6o 

[013] tWfeliftO— 0tt«:^0-C*>S, 

[014] «^C^*IJcJ:o-caE^i-Stt««:RW 

[in s] uftflaft^^frswttdsgaa^nfeiw^"- 

[016] K9>f'<OR»JEfcfcftCTl**t hOTfcffc 
[017] WCiilt h*&Jt«LT£«oW» 
[1216] [114] 



[018] xiis»ds*«-efc*jaa,*iii<feco--'W*^-f' 
0-e&>3 o 

[019] ^iiii«dsa3i«-cfcsm*®*fc<^--«sr^"r 

[02 0] y-{y;v-f-yi:fclt57ry^ST30A 
[02 1] f^-^y|:ibit5^fy^ST3 lol 
[0 2 2] t^v-fy|:*J»t5^fs'^ST3 2©A 
[0 2 3] a«|®«105>»J^il6^>^&«r»^i-*fc«)0 

0-?fc5o 

[024] *|ft®«o»Woilb^#ife«rKWi-5fc«)<o 
0-Cfe^o 

[0 2 5] »«iif«o»«ote^¥«feSrKMi-Sfc«)0 

[026] wa5+*©5MM©— «**"*-eg|-e*>a. 

[0 2 7] 1 Oife© K7^^C 1 OMtlt^ 

v v L,tcmx$>z>o 
[0 2 8] j«ici&ow*c2icj:or*«**uaig 

[0 2 9] »«C 1. *t^lC2, »«C 1 • C2*»fe4 
[03 0] 3&5g-^ hA^Mfttw. ^<£>|gf&g£^ 

^^$ti^>B2co^^^iS:tt/ t c^^lft0^-r^0T* 

[03 1] x a -7Ms/ b^v^««OBW^ 
l |*****U« 

20 Bsmtwftttff 

4 o fltflMtttttUtt 

6 0 

70 ^^P^y^a-^ 



[017] [02 9] 




[Hi] 



4 0 

4 1 J 30 
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62 61 \ 5 
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[0 7] 



im9] 





U o] 



U i] 





[@28] 



[i30] 



(c. d) 




(a, b) 



C1-C2 

C2 




c 1 v. mM«HS^ 
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1 2] 



mi 3i, 



(A) 



(B) 



BK 1 



(C) 



low! 012 015 020 


025 035 085 100 


001 020 020 026 


020 059 080 150 


021 025 026 020 


050 100 126 IHS 


018 020 018 018 


025 085 098 125 


OSS 045 OSS 020 


016 086 086 120 


045 070 020 025 


021 020 O20 025 


021 0S8 028 MB 


021 025 026 02O 


018 035 018 018 


018 020 018 016 


B K 2 


BK 3 



025 086 
G22S)059 



050 100 
026 085 



t 

BK4 
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985 100 
080 160 



126 Eg] 
099 125 

-r 
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025 035 
020 059 
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080 
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099 
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0 0 
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0 0 
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0 
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[118] 



[mi 9] 
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[HJ2 2 J 



im2 3] 
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[i25] 





n urns* 



(51) Int. CI. 7 

B60R 21/00 



G 0 6 T 7/00 
7/20 



6 2 6 

6 2 8 

10 0 

3 0 0 



F I 

B 6 0 R 21/00 



G 0 6 T 7/00 
7/20 



6 2 6 A 

6 2 6G 

6 2 8 F 

1 0 0 B 

3 0 0 Z 



(72) ira mz: 



F ^ — A (##) 5B057 AA06 AA16 BA02 CA01 CA08 
CA12 CA16 CB01 CB08 CB12 
CB16 CC01 CE11 CE17 DA07 
DA 13 DA 15 DB03 DB06 DB09 
DC23 DC25 DC39 
5L096 AA02 AA06 AA09 BA04 CA02 
DA03 FA37 FA52 FA64 GA07 
GA38 GA40 GA41 GA51 
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